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In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment which, for the first time in the 
NAEP's history, made voluntary state-by-state assessments. This 1992 
mathematics report marks the first attempt of the National Center for 
Education Statistics (NCES) to shift to standards -based reporting of National 
Assessment statistics. NAEP results are reported by achievement levels which 
are descriptions of how students should perform relative to a body of content 
reflected in the NAEP frameworks; in other words, how much students should 
know. The 1992 assessment covered six mathematics content areas: (1) numbers 

and operations; (2) measurement; (3) geometry; (4) data analysis, statistics, 
and probability; (5) algebra and functions,- and (6) estimation. In the 
District of Columbia, 2,399 fourth-grade students in 107 public schools and 
1,816 eighth-grade students in 35 public schools were assessed. This report 
describes the mathematics performance of District of Columbia fourth- and 
eighth-grade students in public schools and compares their overall 
performance to students in the Northeast region of the United States and the 
nation. The distribution of the results are provided for subpopulations of 
students including race/ethnicity; type of 

community- -advantaged/disadvantaged urban, extreme rural, and other,- parents' 
education level; gender; and content area performance. To provide a context 
for understanding students' mathematics proficiency, students, their 
mathematics teachers, and principals completed questionnaires which focused 
on: what are students taught? (curriculum coverage, homework, and 
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instructional emphasis) ; how is mathematics instruction delivered? 

(resources, collaborating in small groups, using mathematical objects, and 
materials) ; how are calculators and computers used? (access and use of 
calculators, availability of computers, and when to use a calculator) ; who is 
teaching mathematics? (educational background) ; and conditions beyond school 
that facilitate mathematics learning and teaching (amount of reading 
materials in the home, hours of television watched per day, student 
absenteeism, and students' perceptions of mathematics). The average 
proficiency of fourth-grade students in District of Columbia on the NAEP 
mathematics scale was 191 compared to 217 nationwide; for District of 
Columbia eighth-grade students the average proficiency was 234 compared to 
266 nationwide. (ASK) 
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The National Assessment of Educational Progress (NAEP) is a Congressionally mandated project of the 
National Center for Education Statistics (NCES) that has collected and reported information for nearly 25 
years on what American students know and what they can do. It is the nation’s only ongoing, comparable, 
and representative assessment of student achievement. Its tests are given to scientific samples of youths 
attending both public and private schools and enrolled in grades four, eight, or twelve. The test items are 
written around a framework prepared for each content area -- reading, writing, mathematics, science, and 
others -- that represents the consensus of groups of curriculum experts, educators, members of the general 
public, and user groups on what should be covered on such a test. Reporting includes means and 
distributions of scores, as well as more descriptive information about the meaning of different points on the 
NAEP scale. 

A Recent History of NAEP Reporting 



Over time there have been many changes in emphasis of NAEP testing and reporting both to take advantage 
of new technologies and to reflect changing trends in education. In 1984, a new technology called Item 
Response Theory (IRT) made it possible to create “scale scores” for NAEP similar to those the public was 
accustomed to seeing for the annual Scholastic Aptitude Tests (SAT). Educational Testing Service, in its 
role as Government grantee carrying out NAEP operations, devised a new way to describe performance 
against this scale, called “anchor levels.” Starting in 1984, NAEP results were reported by “anchor levels.” 
Anchor levels describe distributions of performance at selected points along the NAEP scale (i.e., standard 
deviation units). Anchor levels show how groups of students perform relative to each other, but not 
whether this performance is adequate. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and territories to participate 
voluntarily in a trial state assessment, using samples representative of their own students, to provide 
state-level data comparable to the nation and each of the other participating jurisdictions. Pursuant to that 
law, in 1990, the mathematics achievement of eighth graders was assessed in 40 jurisdictions (states, 
territories, and the District of Columbia). The results were reported in The State of Mathematics 
Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States (Washington, 
DC: National Center for Education Statistics, 1991). 
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In the same 1988 law, Congress established the National Assessment Governing Board (NAGB), assigning 
it broad policy making authority over NAEP, including the authority to take “appropriate actions ... to 
improve the form and use of the National Assessment” and to identify “appropriate achievement goals for 
each . . . grade and subject area to be tested in the National Assessment.” To carry out its responsibilities, 
NAGB developed achievement levels, which are collective judgments about how students should perform, 
translated into ranges along the NAEP scale. The process was conducted for NAGB under contract by 
American College Testing (ACT), which has extensive experience in standard- setting in many fields. The 
standards setting process began with questions such as, “What should students know and be able to do if 
they are proficient in mathematics in the fourth, eighth, or twelfth grade?” The National Assessment 
Governing Board, after wide consultation including public hearings, developed statements to describe what 
students should know and be able to do at three levels of proficiency -- “Basic,” “Proficient,” and 
“Advanced” -- for each of the three NAEP grades. A panel of expert and broadly representative judges 
evaluated each NAEP item, judged the proportion of students at each level which should answer the items 
correctly, and made recommendations that resulted in points along the. NAEP scale that corresponded with 
the minimum score for each of these levels. 

In 1990, after Congress had mandated pilot testing at the State level to supplement what had only been 
conducted for the Nation and four large regions, the more rigorous content of the mathematics standards 
prepared by the National Council of Teachers of Mathematics began to influence the NAEP frameworks. 

Also in 1990, the President and the nations’s 50 governors adopted six National Education Goals, including 
one that calls for American students to “leave grades 4, 8, and 12 having demonstrated competency in 
challenging subject matter, including English, mathematics, science, history, and geography.” The adoption 
of this goal highlighted a perceived deficiency in the Nation’s ability to report on the performance of 
students relative to standards developed through a consensus process. 



A Transition Phase in Reporting 

This 1992 mathematics report marks NCES’s first attempt to shift to standards-based reporting of National 
Assessment statistics. The transition is being made now to report NAEP results by “achievement levels.” 
Achievement levels describe how students should perform relative to a body of content reflected in the 
NAEP frameworks (i.e., how much students should know). The impetus for this shift lies in the belief that 
NAEP data will take on more meaning for the public if they show what proportion of our youth are able 
to meet standards of performance necessary for a changing world. Chapter 1 of the report describes how 
the 1992 standards were prepared and provides examples of test exercises that illustrate the mathematics 
content reflected in the descriptions of the NAEP achievement levels. 
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Reporting NAEP results on the basis of achievement levels represents a significant change in practice for 
NCES. On occasion, this agency makes use of emerging analytical approaches that permit new, and 
sometimes controversial, analyses to be done. Just as other statistical agencies do when introducing new 
measures to supplement or replace old measures, NCES has in this report provided the data according to 
the eariier procedures in addition to the new procedures. For this reason, in addition to NAEP results 
reported according to achievement levels, results according to the scale anchoring procedure that has been 
used since the 1984 assessment can be found in an appendix to this report. Presenting the data both ways 
gives the public -- not just technical evaluators -- an opportunity to be informed, so that all data users will 
be able to assess for themselves how well the various forms of reporting and interpreting the data meet their 
needs. 

Technical Review of NCES Reports 

All reports published by NCES are evaluated through an adjudication procedure. This process represents 
a final quality control check designed to assure that all publications conform to statistical standards, are 
grounded in the data, and take into account relevant substantive research literature. The adjudication 
process also attempts to delete misleading interpretive statements, and provide text that is clear and 
understandable to the American public. During the adjudication of this report neither the process for setting 
achievement levels developed by ACT nor the scores representing each level was addressed. The process 
and the cutpoints were taken as a given. The issue of valid inferences was addressed however. A number 
of reviewers interpreted statements about what students should do at the various achievement levels 
according to the standards set by NAGB as statements about what students can do. Independent studies 
are being conducted concerning the appropriate inferences that can be drawn from the NAEP results 
reported by achievement levels. Early results from technical evaluations suggested that this apparently 
logical step in interpretation might not be justified after closer examination of the data about what students 
at these levels actually demonstrate in terms of mathematical competencies. Discussion about the 
achievement levels also raised questions about the need for validity evidence for the anchor levels, as well 
as for greater understanding of the underlying assumptions of the process by which they were 
developed. 1 

This issue led NCES to seek the advice of several technical committees and to convene a meeting of 
technical and policy experts. Members, staff, and contractors of the National Assessment Governing Board 
participated in this meeting. Altogether these activities provided a forum for discussion of various historical 
and proposed approaches to interpreting the NAEP scale. In order to better inform the public about these 
and other interpretation issues, a companion NCES report entitled Interpreting NAEP Scales (Washington, 
DC: National Center for Education Statistics, 1993) explains several approaches to reporting information 
from NAEP. 



1 R.A. Forsyth. “Do NAEP Scales Yield Valid Criterion-referenced Interpretations?” Education Measurement : Issues and Practice, 
10. (1991). pp. 3-9, 16. 
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Actual Student Performance 

Then the next question is: Through their performance on the NAEP items, what actual knowledge and 
abilities did students demonstrate? Chapters 1 - 7 of this report include information on overall means and 
on distributions of scores, all taken directly from the test item data. The Appendix addresses this question 
in the manner that NAEP has used since 1985, using anchor points. As implemented for this report, the 
scale anchoring process provides a concise summary of what students know and can do at various points 
along the scale that differentiates them from students performing at lower levels. First, students performing 
at or around four intervals on the scale were identified (200, 250, 300, and 350 — each of which is one 
standard deviation unit apart). Next, questions were identified that were answered correctly by 65 percent 
or more of the students at one level and by fewer than half of the students at the next lower level. Finally, 
mathematics educators were asked to analyze each anchor-level question and create summary descriptions 
of the knowledge and skills evidenced by students who answered these sets of questions successfully. The 
critical distinction here is that anchor levels attempt to describe what students can do at and around selected 
points on the NAEP scale; achievement levels attempt to describe what students should be able to do in 
various ranges of the NAEP scale. 

Future Work 

These achievement level standards are in the second round (the first being in 1990) in a developmental 
process which has been revised and is still under review through several studies. 2 The Board’s goal is to 
provide a statement of what American students should be able to do as a standard that can give more 
meaning to the NAEP data. They then want to use the NAEP data to inform the nation as to how many 
students actually can meet these standards. 

NCES realizes that modifications and improvements may be necessary in the future as current procedures 
are evaluated and new approaches are considered. NCES conceives of this process as a research and 
developmental activity in which numerous statistical, psychometric, and substantive issues must be resolved. 
At the present time the effort is hampered by the problem of trying to create standards on a given framework 
and item pool developed for another purpose. In the future the measurement of standards will be a more 
prominent influence on the development of NAEP procedures. 



2 Assessing Student Achievement in the States. The First Report of the National Academy of Education Panel on the Evaluation 
of the NAEP Trial State Assessment: 1990 Trial State Assessment. (Stanford, CA: National Academy of Education, 1992).; 
R.L. Linn, D.M. Koretz, E.L. Baker, and L. Burstein. The Validity and Credibility of the Achievement Levels for the 1990 National 
Assessment of Educational Progress in Mathematics , Technical Report CSE No. 330. (Los Angeles, CA: Center for Research on 
Evaluation, Standards, and Student Testing, UCLA, June, 1991). 
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The goal of the National Center for Education Statistics is to make data available for the public and to do 
so in accurate and understandable ways that are not misleading. In this case, much of what matters in 
NAEP is changing: 

• the content in response to the developing standards of various curricular groups; 

• the test items in response to new developments in assessments; and 

• the reporting in response to, and increasing interest in, student achievement relative to 
standards of student performance. 

We believe that the numerous completed and ongoing studies will lead to national debate that will assure 
the public is well informed about these issues — as informed they must be because the results will be a vital 
influence on what Americans come to think about the condition and progress of our schools. 

In addition, the public needs the data in this report to see for themselves what standards-based reporting 
might do and to evaluate the often conflicting claims of adherents and detractors of these changes in 
approaches to reporting on the educational achievement of American students. The Center eventually 
wants to use the achievement levels to describe what students know and can do. In order to accomplish 
that, the frameworks, tests, and achievement levels may need to be developed in tandem. That is easier to 
say than to do, however, because it implies a substantially larger pool of test exercises, carefully designed 
to support reporting about performance relative to a set of performance standards. Clearly this is a 
developmental effort that will take time and several iterations, during which data supporting appropriate 
inferences about the performance of American students will continue to be gathered. 
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NATION’S 




Trial) State Assessment 



In 1988, Congress passed new legislation for the National Assessment of Educational Progress (NAEP) that 
continued its primary mission of providing dependable and comprehensive information about educational 
progress in the United States. In addition, for the first time in the project’s history, the legislation also 
included a provision authorizing voluntary, state-by-state assessments on a trial basis. 



As a result of the legislation, the 1990 NAEP program included a Trial State Assessment Program that 
assessed public-school students in 37 states, the District of Columbia, and two territories in eighth-grade 
mathematics. 3 The 1992 NAEP program included an expanded Trial State Assessment Program in fourth- 
and eighth-grade mathematics and fourth-grade reading, with public-school students assessed in 41 states, 
the District of Columbia, and two territories. In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program in 1990 and in 
1992. 



In the District of Columbia in 1992, 107 public schools participated in the fourth-grade mathematics 
assessment, and 35 participated in the eighth-grade mathematics assessment. The weighted school 
participation rate was 99 percent in fourth grade and 100 percent in eighth grade, which means that the 
fourth-grade students in this sample of schools were representative of 99 percent of all the fourth-grade 
public-school students in the District of Columbia, and the eighth-grade students in this sample of schools 
were representative of 100 percent of all the eighth-grade public- school students in the District of 
Columbia. 



In total, 2,399 fourth-grade and 1,816 eighth-grade District of Columbia public-school students were 
assessed in mathematics. The weighted student participation rate was 93 percent in grade 4 and 85 percent 
in grade 8. This means that the sample of students who took part in the assessment was representative of 
93 percent and 85 percent of the eligible fourth-grade and eighth-grade public-school student populations 
in participating schools in the District of Columbia (that is, all students minus those excluded from the 
assessment). The overall weighted response rate (school rate times student rate) was 92 percent in fourth 
grade and 85 percent in eighth grade. This means that the sample of students who participated in the 
assessment was representative of 92 percent and 85 percent of the eligible fourth- and eighth-grade 



and Gary W. Phillips. The State 

of Mathematics Achievement: NAEP's 1990 Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: 
National Center for Education Statistics, 1991). 
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Students’ Mathematics Performance 



Students’ performance in mathematics was summarized on the NAEP mathematics scale, which ranges 
from 0 to 500. 



Grade 4 The average proficiency of public-school students from the District of Columbia on the 

1992 NAEP mathematics scale was 191. This proficiency was lower than that of students 

across the nation (217). 4 The lowest performing 10 percent of the students from the 
District of Columbia had proficiencies below 152 while the top 10 percent of the students 
had proficiencies above 233. 



Grade 8 The average proficiency of public-school students from the District of Columbia on the 

1992 NAEP mathematics scale was 234. This proficiency was lower than that of students 

across the nation (266). The lowest performing 10 percent of the students in the District 
of Columbia had proficiencies below 189 while the top 10 percent of the students had 
proficiencies above 280. 



Grade 8 
1990 vs 1992 



The average proficiency of public-school students in the District of Columbia in 1992 
was somewhat higher than the average proficiency in 1990 (234 in 1992 and 231 in 1990). 
In the District of Columbia, the score that signified the 10th percentile in 1992 (189) was 
about the same as the score that signified the 10th percentile in 1990 (190). Similarly, the 
score that signified the 90th percentile in 1992 (280) was about the same as* the score that 
signified the 90th percentile in 1990 (274). 



LEVELS OF ACHIEVEMENT 

When Congress established the National Assessment Governing Board (NAGB) in 1988 to set policy for 
NAEP, it charged the board with “identifying appropriate achievement goals for each age and grade in each 
subject area to be tested under the National Assessment.” (Pub. L. 297-100 Section 3403 (a)(5)(B)(ii)). 



NAGB developed three achievement levels for each grade — Basic, Proficient, and Advanced. Performance 
at the Basic level denotes partial mastery of the knowledge and skills that are fundamental for proficient 
work at each grade level. The central level, called Proficient, represents solid academic performance at each 
grade level tested. Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Achievement at the Advanced level signifies superior 
performance at the grade tested. 

Grade 4 About one quarter of the students in public schools in the District of Columbia 

1992 (25 percent), versus 59 percent in the nation, are at or above the Basic level. Relatively 

few of the students in the District of Columbia (6 percent), versus 18 percent in the 
nation, are at or above the Proficient level. Relatively few of the students in the District 
of Columbia (1 percent), versus 2 percent in the nation, are at or above the Advanced 
level. 



* Recall that “about the same” means that the difference between these two groups, although it may appear large, is not statistically 
significant. 

4 Differences reported are statistically significant at the 95 percent confidence level. This means that with 95 percent confidence, 
there is a real difference in the average mathematics proficiency between the two populations of interest. “About the same” 
means that no statistically significant difference was found at the 95 percent confidence level. 
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Grade 8 
1992 






Grade 8 
1990 vs 1992 



About one quarter of the public-school students in the District of Columbia (26 percent), 
versus 61 percent in the nation, are at or above the Basic level, while relatively few of the 
students in the District of Columbia (6 percent), versus 23 percent in the nation, are at 
or above the Proficient level, and relatively few of the students in the District of Columbia 
(1 percent), versus 3 percent in the nation, are at or above the Advanced level. 

Compared to 1990, there was an increase in the percentage of students in the District of 
Columbia at or above the Basic level (26 percent in 1992 compared to 21 percent in 
1990), no significant difference in the percentage of students at or above the Proficient 
level (6 percent in 1992 compared to 4 percent in 1990), and no significant difference in 
the percentage of students at or above the Advanced level (1 percent in 1992 compared 
to 1 percent in 1990). 



CONTENT AREA PERFORMANCE 



The questions comprising the Trial State Assessment covered the content areas of Numbers and Operations; 
Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and Functions; as well as 
Estimation skills. Estimation was measured using a special paced audiotape that limited the amount of time 
students had to work on each question and made any direct calculations of answers difficult. The 
information from the Estimation section is intended to supplement the data obtained from the Numbers 
and Operations and the Measurement questions administered using the more traditional paper-and-pencil 
or calculator approaches. 

Students in the District of Columbia performed lower than students in the nation in all 
of the six areas. 



Students in the District of Columbia performed lower than students in the nation in all 
of the six areas. 

Estimation was not included in the 1990 Trial State Assessment program. Therefore, 
change in eighth-grade performance is provided only for the five content areas. There 
was an improvement in student performance from 1990 to 1992 in the District of 
Columbia in Numbers and Operations and Data Analysis, Statistics, and Probability. 



Subpopulation Performance 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 | 
1990 vs 1992 1 



Many of the reforms recommended for mathematics education have emphasized the need to stress 
mathematics for all students. 5 Nevertheless, assessment results consistently show lower achievement for 
subpopulations of students who are less advantaged than their classmates. 6 The 1992 Trial State 
Assessment sheds further light on this by reporting on the performance of various subgroups of the student 
population defined by race/ethnicity, type of community, parents' education level, and gender. 



3 Everybody Counts: A Report to the Nation on the Future of Mathematics Education , Lynn Steen, Ed. (Washington, DC: National 
Research Council, National Academy Press, 1989). 



6 lna V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement : NAEP's 1990 
Assessment of the Nation and the Trial Assessment of the States . (Washington, DC: National Center for Education Statistics, 
1991). 
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In the District of Columbia: 



RACE/ETHNICITY 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. About half of the White students (52 percent), relatively few of the 
Black students (3 percent), and relatively few of the Hispanic students (2 percent) were 
at or above the Proficient level. 

Black students demonstrated about the same average mathematics proficiency as did 
Hispanic students. Relatively few of the Black students (4 percent) and relatively few of 
the Hispanic students (7 percent) were at or above the Proficient level. 

The performance of Black and Hispanic students stayed about the same from 1990 to 
1992. About the same percentage of Black and Hispanic students were at or above the 
Proficient level in 1992 as in 1990. 



TYPE OF COMMUNITY 



Grade 4 
1992 



Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban areas 
or areas classified as “other”. Some of the students attending schools in advantaged urban 
areas (17 percent), relatively few of the students in disadvantaged urban areas (2 percent), 
and relatively few of the students in areas classified as “other” (8 percent) were at or 
above the Proficient level. 



Grade 8 
1992 



Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban areas 
and about the same mathematics proficiency as did students attending schools in areas 
classified as “other”. Some of the students attending schools in advantaged urban areas 
(12 percent), relatively few of the students in disadvantaged urban areas (1 percent), and 
some of the students in areas classified as “other” (16 percent) were at or above the 
Proficient level. 



Grade 8 
1990 v$ 1992 



The performance of students in areas classified as “other” was higher in 1992 than it was 
in 1990. Students in advantaged urban areas and disadvantaged urban areas performed 
about the same in 1992 as in 1990. A greater percentage of students in areas classified 
as “other” were at or above the Proficient level in 1992 than in 1990. About the same 
percentage of students in advantaged urban areas and disadvantaged urban areas were at 
or above the Proficient level in 1992 as in 1990. 
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PARENTS’ EDUCATION LEVEL 



Grade 4 
1992 



Students who reported that at least one parent graduated from college demonstrated 
about the same average mathematics proficiency as did students who reported that at least 
one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 
Achievement was at or above the Proficient level for 9 percent of the students who 
reported that at least one parent graduated from college, 7 percent of the students who 
reported that at least one parent had some education after high school, 2 percent of the 
students who reported that at least one parent graduated from high school, 1 percent of 
the students who reported that neither parent graduated from high school, and 3 percent 
of the students who reported that they did not know their parents’ education level. 



Grade 8 
1992 



Students who reported that at least one parent graduated from college demonstrated 
about the same average mathematics proficiency as did students who reported that at least 
one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 
Achievement was at or above the Proficient level for 1 1 percent of the students who 
reported that at least one parent graduated from college, 4 percent of the students who 
reported that at least one parent had some education after high school, 2 percent of the 
students who reported that at least one parent graduated from high school, 3 percent of 
the students who reported that neither parent graduated from high school, and 3 percent 
of the students who reported that they did not know their parents’ education level. 



Grade 8 
1990 vs 1992 



Students who reported that at least one parent graduated from college, at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level performed about the same in 1992 as in 1990. About the same percentage of 
students who reported that at least one parent graduated from college, at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level were at or above the Proficient level in 1992 as in 1990. 



GENDER 



Grades 4 & 8 
1992 



In the District of Columbia, in both fourth grade and eighth grade, there appears to be 
no significant difference in the average mathematics proficiency of males and females 
attending public schools. There was no significant difference between the percentages of 
fourth-grade males and females who were at or above the Proficient level (5 percent for 
females and 6 percent for males). In addition, there was no significant difference between 
the percentages of eighth-grade males and females who were at or above the Proficient 
level (6 percent for females and 5 percent for males). 



Grade 8 
1990 vs 1992 



The average mathematics proficiency for eighth-grade females in 1 992 was about the same 
as the average mathematics proficiency for eighth-grade females in 1990. The average 
mathematics proficiency for eighth-grade males in 1992 was about the same as the average 
mathematics proficiency for eighth-grade males in 1990. Furthermore, about the same 
percentage of eighth-grade males were at or above the Proficient level in 1992 as in 1990. 
About the same percentage of eighth-grade females were at or above the Proficient level 
in 1992 as in 1990. 
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A Context for Understanding Students’ Mathematics Proficiency 



The results of the Trial State Assessment can be used to monitor students’ progress in achieving the 
recommendations of the National Council of Teachers of Mathematics and to examine both school and 
home contexts for educational support. The public-school students participating in the 1992 Trial State 
Assessment, their mathematics teachers, and the principals or other administrators in their schools were 
asked to complete questionnaires on policies, instruction, and programs. These student, teacher, and school 
data help to describe some of the current practices and emphases in mathematics education, illuminate some 
of the factors that appear to be related to fourth- and/or eighth-grade public-school students’ proficiency in 
the subject, and provide an educational context for understanding data on student achievement. The data 
from the questionnaires also provide a means to examine changes in policies, instruction, and programs at 
the eighth-grade level between 1990 and 1992 for those states and territories that participated in both Trial 
State Assessment Programs. 



Highlights of the results for the public-school students in the District of Columbia are as follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• According to their mathematics teachers, 75 percent of the fourth-grade students and 
52 percent of the eighth-grade students received four or more hours of mathematics 
instruction per week. 

• According to their mathematics’ teachers, the greatest percentage of fourth-grade students 
were assigned 30 minutes of mathematics homework each day, and the greatest percentage 
of eighth-grade students were assigned 30 minutes of mathematics homework each day. 

• According to the students in grade 8, average mathematics proficiency was higher for 
students in the District of Columbia who spent 30 minutes on mathematics homework than 
for students who spent no time on mathematics homework each day. 

• In the District of Columbia, 84 percent of the fourth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 35 percent 
had teachers who placed heavy instructional emphasis on Measurement, 30 percent had 
teachers who placed heavy instructional emphasis on Geometry, 19 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
12 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 

• In the District of Columbia, 59 percent of the eighth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 18 percent 
had teachers who placed heavy instructional emphasis on Measurement, 24 percent had 
teachers who placed heavy instructional emphasis on Geometry, 29 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
54 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 
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DELIVERY OF MATHEMATICS INSTRUCTION 

• According to the mathematics teachers in the District of Columbia, 85 percent of the 
fourth-grade students and 80 percent of the eighth-grade students worked mathematics 
problems in small groups at least weekly; relatively few in grade 4 and relatively few in 
grade 8 never or hardly ever worked mathematics problems in small groups (4 percent and 
5 percent, respectively). 

• According to the students in the District of Columbia, 54 percent of the fourth-grade 
students and 53 percent of the eighth-grade students worked mathematics problems in small 
groups at least weekly; 33 percent in grade 4 and 30 percent in grade 8 reported never or 
hardly ever working mathematics problems in small groups. 

• According to the mathematics teachers in the District of Columbia, 39 percent of the 
fourth-grade students and 71 percent of the eighth-grade students were assigned problems 
from a mathematics textbook almost every day; 7 percent and 5 percent in fourth and 
eighth grade, respectively, worked textbook problems less than weekly. 

• According to the students in the District of Columbia, 41 percent of the fourth-grade 
students and 59 percent of the eighth-grade students were assigned problems from a 
mathematics textbook almost every day; 28 percent and 12 percent in fourth and eighth 
grade, respectively, worked textbook problems less than weekly. 

USE OF CALCULATORS 

• In the District of Columbia, 71 percent of eighth-grade students were in schools in which 
they were given access to four-function calculators and 84 percent were in schools in which 
they were given access to scientific calculators. Across the nation, these figures were 
66 percent for four-function calculators and 37 percent for scientific calculators. In 
addition, in the District of Columbia, 62 percent of eighth graders had mathematics teachers 
who reported providing instruction to students about the use of four-function calculators 
and 74 percent had teachers who reported providing instruction about scientific calculators. 
Nationally, these figures were 64 percent and 37 percent of the eighth-grade students, 
respectively. 

• According to the students’ mathematics teachers, 59 percent of the fourth-grade students 
and 61 percent of the eighth-grade students used calculators at least once a week in 
mathematics class. By comparison, 13 percent and 12 percent in fourth and eighth grade, 
respectively, never or hardly ever used a calculator. In 1990, 57 percent of the eighth-grade 
students had mathematics teachers who reported that they used calculators at least once a 
week and 9 percent had mathematics teachers who reported that they never or hardly ever 
used calculators. 



EDUCATIONAL BACKGROUND OF TEACHERS 

• In the District of Columbia, 48 percent of the fourth-grade students and 58 percent of the 
eighth-grade students were being taught by mathematics teachers who reported having at 
least a master’s or education specialist’s degree. Across the nation, these figures were 
47 percent and 47 percent for fourth- and eighth-grade students, respectively. 

• In the District of Columbia. 4 percent of the fourth-grade and 63 percent of the 
eighth-grade public-school students were being taught mathematics by teachers who had an 
undergraduate major in mathematics. Across the nation, 5 percent of the fourth-grade 
students and 45 percent of the eighth-grade students had mathematics teachers with a major 
in mathematics. 
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HOME FACTORS 

• Grade 4 students in the District of Columbia who had all four types of reading materials (an 
encyclopedia, newspapers, magazines, and more than 25 books in the home) showed a 
higher mathematics proficiency than did students with zero to two types of materials. This 
is similar to the results for the grade 8 students in the District of Columbia, where students 
who had all four types of materials showed a higher mathematics proficiency than did 
students who had zero to two types. 

9 Some of the fourth-grade public-school students in the District of Columbia (16 percent) 
watched one hour or less of television each day; 37 percent watched six hours or more. 

• Relatively few of the eighth-grade public-school students in the District of Columbia 
(7 percent) watched one hour or less of television each day; 31 percent watched six hours 
or more. In 1990, 8 percent watched one hour or less of television each day while 
33 percent watched six hours or more. 



Comparisons of Overall Mathematics Proficiency in the District of Columbia with 
Other States 



The maps on the following pages provide a method for making appropriate comparisons of the average 
overall mathematics proficiency in the District of Columbia with that in the other states (including the 
District of Columbia) and territories that participated in the NAEP 1992 Trial State Assessment Program. 
The different shadings of the states on the map show whether the average overall proficiency in the other 
states was statistically different from or not statistically different from that in the District of Columbia 
(“Target State”). States with a dark-colored shading have a significantly higher average proficiency than 
does the District of Columbia. States with a light-colored shading have a significantly lower average 
proficiency than does the District of Columbia. States without shading are not significantly different from 
the District of Columbia. The significance tests are based on a Bonferroni procedure for multiple 
comparisons that holds the probability of erroneously declaring the means of any two states to be different, 
when they are not, to five percent across all possible comparisons. Separate maps are provided for the 
results for grade 4 and grade 8. 
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Comparisons of Overall Mathematics Proficiency at Grade 8 

District of Columbia 
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Trial State AsMument 



In 1988, Congress passed new legislation for the National Assessment of Educational Progress (NAEP) that 
continued its primary mission of providing dependable and comprehensive information about educational 
progress in the United States. In addition, for the first time in the project’s history, the legislation also 
included a provision authorizing voluntary, state-by-state assessments on a trial basis: 

The National Assessment shall develop a trial mathematics assessment survey instrument for the 
eighth grade and shall conduct a demonstration of the instrument in 1990 in States which wish to 
participate , with the purpose of determining whether such an assessment yields valid , reliable State 
representative data. (Section 406(i)(2)(C)(i) of the General Education Provisions Act , as 
amended by Pub. L . 100-297 (U.S.C. 1221e-l (i)(2)(c)(i))) 

The National Assessment shall conduct a trial mathematics assessment for the fourth and eighth 
grades in 1992 and , pursuant to subparagraph (6)(D), shall develop a trial reading assessment 
to be administered in 1992 for the fourth grade in States which wish to participate, with the 
purpose of determining whether such an assessment yields valid, reliable State representative data. 
(Section 406(i)(2)(C)(i) of the General Education Provisions Act, as amended by Pub. L. 
100-297 (U.S.C. 1221e-l(i)(2)(c)(ii))) 



As a result of the legislation, the 1990 NAEP program included a Trial State Assessment Program that 
assessed public-school students in 37 states, the District of Columbia, and two territories in eighth-grade 
mathematics. 7 The 1992 NAEP program included an expanded Trial State Assessment Program in fourth- 
and eighth-grade mathematics and fourth-grade reading, with public-school students assessed in 41 states, 
the District of Columbia, and two territories. In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program in 1990 and in 
1992. 



7 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The Stale 
of Mathematics Achievement : NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: 
National Center for Education Statistics, 1991). 
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The 1992 Trial State Assessment Program was conducted in February 1992 with the following 44 
participants: 
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* The Virgin Islands participated in the testing portion of the 1992 Trial State Assessment Program. However, in accordance with 
the legislation providing for participants to review and give permission for release of their results, the Virgin Islands chose not to 
release their results at grade 4 in the reports. 



States in bold type did not participate in the 1990 Trial State Assessment. Three states — Montana, Illinois, 
and Oregon -- participated in the 1990 Trial State Assessment but not in the 1992 program. 



For the 1992 Trial State Assessment, approximately 2,500 students were assessed in each jurisdiction for 
each grade and subject area. The samples were carefully designed to represent the fourth- and eighth-grade 
public-school populations in each state or territory. Similar to the 1990 program, local school district 
personnel administered all assessment sessions, and the contractor’s staff monitored 50 percent of the 
sessions as part of the quality assurance program designed to ensure that the sessions were conducted 
uniformly. The results of the monitoring in 1990 and 1992 indicated a high degree of quality and uniformity 
across sessions. 

Both the 1990 and 1992 Trial State Assessments in mathematics were based on a set of objectives developed 
for the program and patterned after the consensus process described in Public Law 98-51 1, Section 405 (E), 
which authorized NAEP through June 30, 1988. Anticipating the 1988 legislation that authorized the Trial 
State Assessment, the National Science Foundation and the U.S. Department of Education issued a special 
grant to the Council of Chief State School Officers in mid- 1987 to develop the objectives. The objectives 
development process included careful attention to the standards developed by the National Council of 
Teachers of Mathematics, 8 the formal mathematics objectives of states and of a sampling of local districts, 
and the opinions of practitioners at the state and local levels as to what content should be assessed. 

8 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of M athematics, 1989). 
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The objectives were reviewed extensively by mathematics educators, scholars, states’ mathematics 
supervisors, the National Center for Education Statistics (NCES), and the Assessment Policy Committee 
(APC), a panel advising on NAEP policy at that time. They were further refined by NAEP’s Item 
Development Panel, reviewed by the Task Force on State Comparisons, and resubmitted to NCES for peer 
review. Because the objectives needed to be coordinated across all grades for the national program, the final 
objectives provided specifications for the NAEP mathematics assessment at the fourth, eighth, and twelfth 
grades, rather than solely for the Trial State Assessment Program. An overview of the mathematics 
objectives is provided in the Procedural Appendix. 



This Report 

This is a computer-generated report that describes the mathematics performance of fourth- and eighth-grade 
public-school students in the District of Columbia, in the Northeast region, and across the nation. A 
separate report will describe the results of the fourth-grade reading assessment. This report consists of three 
sections: 

• The Overview provides background information about the Trial State Assessment and a 
profile of the fourth- and eighth-grade public- school students in the District of Columbia. 

• Part One describes the mathematics performance of the fourth- and eighth-grade 
public-school students in the District of Columbia, the Northeast region, and the nation. 

It also describes the change in eighth-grade performance for those jurisdictions that 
participated in both the 1990 and 1992 Trial State Assessment Programs. 

• Part Two relates fourth- and eighth-grade students’ mathematics performance to contextual 
information about the mathematics policies and instruction in the District of Columbia, the 
Northeast region, and the nation. Part Two also compares the eighth-grade data for 1990 
and 1992 for those jurisdictions that participated in both Trial State Assessment Programs. 

In this report, results are provided for groups of students defined by shared characteristics -- race/ethnicity, 
type of community, parents’ education level, and gender. Definitions of these subpopulations are presented 
below. The results for the District of Columbia are based on the representative sample of students who 
participated in the 1992 Trial State Assessment Program. The results for the nation and the region of the 
country are based on the nationally and regionally representative samples of public-school students who 
were assessed in January through March as part of the 1992 national NAEP program. Using the regional 
and national results from the 1992 national NAEP program is necessary because the voluntary nature of the 
Trial State Assessment Program did not guarantee representative national or regional results from the 
aggregated data across states, since not every state participated in the program. Specific details on the 
samples and analysis procedures used in 1990 and 1992 can be found in the Technical Reports for the 
NAEP Trial State Assessment Program for each of the assessment years. 9 



Technical Report of NAEP’s 1990 Trial State Assessment Program. (Washington, DC: National Center for Education Statistics, 
1991).; Technical Report of the NAEP 1992 Trial State Assessment in Mathematics. (Washington, DC: National Center for 
Education Statistics, 1993). 
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RACE/ETHNICITY 

Results are presented for students of different racial/ethnic groups based on the students’ self-identification 
of their race/ethnicity according to the following mutually exclusive categories: White, Black, Hispanic, 
Asian (including Pacific Islander), and American Indian (including Alaskan Native). Based on criteria 
described in the Procedural Appendix, there must be at least 62 students in a particular subpopulation in 
order for the results for that subpopulation to be considered reliable. Thus, results for racial/ethnic groups 
with fewer than 62 students are not reported. However, the data for all students, regardless of whether their 
racial/ethnic group was reported separately, were included in computing overall results for the District of 
Columbia. In addition, change in eighth-grade performance from 1990 to 1992 is reported only for those 
racial/ethnic groups for which there were at least 62 students in both the 1990 and 1992 samples. 



TYPE OF COMMUNITY 

Results are provided for four mutually exclusive community types -- advantaged urban, disadvantaged 
urban, extreme rural, and other -- as defined below: 

Advantaged Urban : Students in this group live in metropolitan statistical areas and attend 

schools where a high proportion of the students’ parents are in professional or managerial 
positions. 

Disadvantaged Urban : Students in this group live in metropolitan statistical areas and attend 
schools where a high proportion of the students’ parents are on welfare or are not regularly 
employed. 

Extreme Rural: Students in this group live outside metropolitan statistical areas, live in areas 
with a population below 10,000, and attend schools where many of the students’ parents are 
farmers or farm workers. 

Other: Students in this category attend schools in areas other than those defined as advantaged 
urban, disadvantaged urban, or extreme rural. 



The reporting of results by each type of community was also subject to a minimum student sample size of 
62. Change in eighth-grade performance is reported only for those types of communities for which there 
were at least 62 students in both the 1990 and 1992 samples. 



PARENTS’ EDUCATION LEVEL 

Students were asked to indicate the extent of schooling for each of their parents - did not finish high school, 
graduated from high school, some education after high school, or graduated from college. The response 
indicating the higher level of education was selected for reporting. Reporting of results by parents’ 
education level was also subject to a rninimum student sample size of 62, and change in eighth-grade 
performance is reported only for those levels of parents’ education for which there were at least 62 students 
in both the 1990 and 1992 samples. 
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GENDER 

Results are reported separately for males and females. 



REGION 

The United States has been divided into four regions: Northeast, Southeast, Central, and West. States 
included in each region are shown in Figure 1. All 50 states and the District of Columbia are listed, with 
the participants in the Trial State Assessment highlighted in boldface type. Territories were not assigned 
to a region. Further, the part of Virginia that is included in the Washington, DC, metropolitan statistical 
area is included in the Northeast region; the remainder of the state is included in the Southeast region. 
Because most of the students are in the Southeast region, regional comparisons for Virginia are to the 
Southeast. 
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Guidelines for Analysis and Reporting 



This report describes the mathematics proficiency of fourth- and eighth-grade students attending public 
schools and compares the results for various groups of students within that population — for example, those 



who have certain demographic characteristics or who responded to a specific background question in a 
particular way. The report examines the results for individual groups and individual background questions. 
It does not include an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the proportions of students in these groups and their average proficiency are based on samples — 
rather than the entire population of fourth or eighth graders in public schools in the state or territory — the 
numbers reported are necessarily estimates. As such, they are subject to a measure of uncertainty, reflected 
in the standard error of the estimate. When the proportions or average proficiency of certain groups are 
compared, it is essential that the standard error be taken into account, rather than relying solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based on statistical tests 
that consider both the magnitude of the difference between the means or proportions and the standard errors 
of those statistics. 

The statistical tests determine whether the evidence — based on the data from the groups in the sample — 
is strong enough to conclude that the means or proportions are really different for those groups in the 
population. If the evidence is strong (i.e., the difference is statistically significant ), the report describes the 
group means or proportions as being different (e.g., one group performed higher than or lower than another 
group) — regardless of whether the sample means or sample proportions appear to be about the same or 
not. If the evidence is not sufficiently strong (i.e., the difference is not statistically significant), the means 
or proportions are described as being about the same — again, regardless of whether the sample means or 
sample proportions appear to be about the same or widely discrepant. The reader is cautioned to rely on 
the results of the statistical tests — rather than on the apparent magnitude of the difference between sample 
means or proportions — to determine whether those sample differences are likely to represent actual 
differences between the groups in the population. The statistical tests and Bonferroni procedure, which is 
used when more than two groups are being compared, are discussed in greater detail in the Procedural 
Appendix. 

In addition, some of the percentages reported in the text of the report are given quantitative descriptions. 
The descriptive phrases used and the rules used to select them are also described in the Procedural 



Appendix. 
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Finally, in several places in this report, results (mean proficiencies and proportions) are reported in the text 
for combined groups of students. For example, in the text, the percentage of students in the combined 
group taking either algebra or pre-algebra is given and compared to the percentage of students enrolled in 
eighth-grade mathematics. However, the tables that accompany that text report percentages and 
proficiencies separately for the three groups (algebra, pre-algebra, and eighth-grade mathematics). The 
combined-group percentages reported in the text and used in all statistical tests are based on unrounded 
estimates (i.e., estimates calculated to several decimal places) of the percentages in each group. The 
percentages shown in the tables are rounded to integers. Thus, percentages may not always add up to 100 
percent due to rounding. Also, the percentage for a combined group (reported in the text) may differ slightly 
from the sum of the separate percentages (presented in the tables) for each of the groups that were 
combined. Therefore, if statistical tests were to be conducted based on the rounded numbers in the tables, 
the results might not be consonant with the results of the statistical tests that are reported in the text (based 
on unrounded numbers). 



Profile of the District of Columbia 

FOURTH- AND EIGHTH-GRADE SCHOOL AND STUDENT CHARACTERISTICS 

Table 1 provides a profile of the demographic characteristics of the fourth- and eighth-grade public-school 
students in the District of Columbia, the Northeast region, and the nation. The profile is based on data 
collected from the students and schools participating in the 1992 NAEP mathematics assessments. 

SCHOOLS AND STUDENTS ASSESSED 

Table 2 summarizes participation data for District of Columbia schools and students sampled for both the 
1990 and 1992 Trial State Assessment in mathematics. 10 In the District of Columbia, in 1992, 107 public 
schools participated in the fourth-grade assessment, and 35 participated in the eighth-grade assessment. 
These numbers include participating substitute schools that were selected for some of the nonparticipating 
schools from the original sample. The weighted school participation rate was 99 percent in fourth grade 
and 100 percent in eighth grade, which means that the fourth-grade students in this sample of schools were 
representative of 99 percent of all the fourth-grade public-school students in the District of Columbia, and 
the eighth-grade students in this sample of schools were representative of 100 percent of all the eighth-grade 
public-school Q students in the District of Columbia. 



For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates for the 
Mathematics Assessment (Washington, DC: National Center for Education Statistics, 1992).; or see Appendix B of the 1992 
State Technical Report 
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In each school, a random sample of students was selected to participate in the assessment. As estimated 
by the sample, 4 percent of the fourth-grade and 3 percent of the eighth-grade public-school populations 
were classified as Limited English Proficient (LEP), while 8 percent in fourth grade and 9 percent in eighth 
grade had an Individualized Education Plan (IEP). An IEP is a plan, written for a student who has been 
determined to be eligible for special education, that typically sets forth goals and objectives for the student 
and describes a program of activities and/or related services necessary 7 to achieve the goals and objectives. 
Handicapped or disabled students may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment. To be excluded, a student had to 
be categorized as Limited English Proficient or had to have an Individualized Education Plan and (in either 
case) be judged incapable of participating in the assessment. The intent was to assess all selected students; 
therefore, all selected students who were capable of participating in the assessment should have been 
assessed. However, schools were allowed to exclude those students who, in the judgment of school staff, 
could not meaningfully participate. The NAEP guidelines for exclusion are intended to assure uniformity 
of exclusion criteria from school to school. Note that some LEP and IEP students were deemed eligible 
to participate and not excluded from the assessment. The students in the District of Columbia who were 
excluded from the assessment because they were categorized as LEP or had an IEP represented 9 percent 
and 9 percent of the population, respectively, in grades 4 and 8. 

In total, 2,399 fourth-grade and 1,816 eighth-grade District of Columbia public-school students were 
assessed in mathematics. The weighted student participation rate was 93 percent in grade 4 and 85 percent 
in grade 8. This means that the sample of students who took part in the assessment was representative of 
93 percent and 85 percent of the eligible fourth-grade and eighth-grade public-school student populations 
in participating schools in the District of Columbia (that is, all students minus those excluded from the 
assessment). 

The overall weighted response rate (school rate times student rate) was 92 percent in fourth grade and 
85 percent in eighth grade. This means that the sample of students who participated in the assessment was 
representative of 92 percent and 85 percent of the eligible fourth- and eighth-grade public-school student 
populations in the District of Columbia, respectively. 
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Profile of Public-School Students in the 
District of Columbia, the Northeast region, 
and the Nation 



Trial State Assessment 



Grade 4 



1992 
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1990 



1992 



DEMOGRAPHIC SUBGROUPS 
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Northeast 



Nation 



District of Columbia 
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American Indian 
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TYPE OF COMMUNITY 

Advantaged Urban 
Disadvantaged Urban 
Extreme Rural 
Other 

Advantaged Urban 
Disadvantaged Urban 
Extreme Rural 
Other 
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Extreme Rural 
Other 

PARENTS ' EDUCATION 
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Did not finish high school 

I don't know 
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Some education after high school 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was' significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. The percentages for Race/Ethnicity may not add to 100 percent because some students categorized themselves as 
“Other.” 
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PUBLIC SCHOOL PARTICIPATION 



Weighted school participation rate before substitution 

Weighted school participation rate after substitution 

Number of schools originally sampled 

Number of schools not eligible 

Number of schools in original sample participating 

Number of substitute schools provided 

Number of substitute schools participating 

Total number of participating schools 



PUBLIC-SCHOOL STUDENT PARTICIPATION 



Weighted student participation rate after makeups 

Number of students selected to participate in the assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English Proficiency 

Percentage of students excluded from the assessment due to 
Limited English Proficiency 

Percentage of students who had an Individualized Education Plan 

Percentage of students excluded from the assessment due to 
Individualized Education Plan status 

Number of students to be assessed 

Number of students assessed 

Overall weighted response rate 



In grade 8 in the District of Columbia, the Trial State Assessments were based on all eligible schools in both 1990 and 1992. There 
was no sampling of schools. 
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How Proficient in Mathematics Are Fourth- 
and Eighth-Grade Students in 
Dist. of Columbia Public Schools? 



Both the 1990 and 1992 Trial State Assessments covered five mathematics content areas — Numbers and 
Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. In addition, items measuring a sixth area - Estimation -- were included in the 1992 Trial State 
Assessment. Estimation was covered in both the 1990 and 1992 national NAEP programs, but not the 1990 
Trial State Assessment. 

This part of the report contains two chapters that describe the mathematics proficiency of fourth- and 
eighth-grade public-school students in the District of Columbia. Chapter 1 compares the overall 
mathematics performance of the students in the District of Columbia to students in the Northeast region 
and the nation. It also presents students’ average proficiency separately for each mathematics content area. 
Chapter 2 summarizes students’ overall mathematics performance for subpopulations defined by 
race/ethnicity, type of community, parents’ education level, and gender, as well as their mathematics 
performance in the content areas. Both chapters also describe the change in performance of eighth-grade 
public-school students from 1990 to 1992 for those jurisdictions that participated in the Trial State 
Assessment in both years. 
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CHAPTER 1 

Students’ Mathematics Performance 



Students’ performance in mathematics was summarized on the NAEP mathematics scale, which ranges 
from 0 to 500. As shown in Table 3A: 

Grade 4 The average proficiency of public-school students from the District of Columbia on the 

1992 NAEP mathematics scale was 191. This proficiency was lower than that of students 

across the nation (2 17). 11 



Grade 8 
1992 



The average proficiency of public-school students from the District of Columbia on the 
NAEP mathematics scale was 234. This proficiency was lower than that of students 
across the nation (266). 



Grade 8 
1990 vs 1992 



The average proficiency of public-school students in the District of Columbia in 1992 
was somewhat higher than the average proficiency for 1990 (234 in 1992 and 231 in 1990). 
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table 3A | Average Fourth-Grade and Eighth-Grade 
I Public-School Mathematics Proficiency 



Grade 4 


Grade 8 


1992 


1990 


1992 







V.f /Mcimity ; {v 




District of Columbia 




V-/. 231 ! ( 0 . 9 ) ' 


,, , 234 | Q. 3 ) > 


Northeast 




270 ( 3 . 3 ) 


If ■; 267 ( 3 . 0 ) 


Nation 


217 ( 0 . 8 } 


lit;-: 262 ( 1 . 4 ) 





The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 



11 Differences reported are statistically significant at the 95 percent confidence level. This means that with 95 percent confidence, 
there is a real difference in the average mathematics proficiency between the two populations of interest. “About the same” 
means that no statistically significant difference was found at the 95 percent confidence level. 
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There was also a tremendous range in student performance within each grade as shown by the percentile 
distributions presented in Table 3B. 



Grade 4 
1992 



The lowest performing 10 percent of the students from the District of Columbia had 
proficiencies below 152 while the top 10 percent of the students had proficiencies above 



233. 



Grade 8 
1992 



The lowest performing 10 percent of the students in the District of Columbia had 
proficiencies below 189 while the top 10 percent of the students had proficiencies above 



280. 



Grade 8 
1990 vs 1992 



In the District of Columbia, the score that signified the 10th percentile in 1992 (189) was 
about the same as the score that signified the 10th percentile in 1990 (190). Similarly, the 
score that signified the 90th percentile in 1992 (280) was about the same as* the score that 
signified the 90th percentile in 1990 (274). 
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TABLE 3B 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 



5th 


10th 


25th 


50th 


75th 


90th 


95th 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 1992 
District of Columbia 

Northeast 

Nation 


llfl 1.0) 152 ( 0.7) 169 ( 0.7) ISO ( 0.7) 211 ( 0.9) 233 ( 2,2) 250 ( 1.6) 

165 ( 3.1) 170 ( 3.1) 200 ( 2.6) 225 ( 3.4) 246 ( 3.4) 264 ( 3.8) 274 ( 3.0) 

161 ( 1.5) 174(0.7) 196(1.0) 219 ( 0.9) 240(1.3) 259(1.1) 269 ( 2.0) 




GRADE 8 1990 
District of Columbia 

Northeast 

Nation 


,•179 (■ 1.4) ■ 190(1.7) 209 ( 1J1) ^ 230,(0.9) ,252( 1.3) / 274 (2.5) ' 288 ( 2.4) 

;'211',( 5.4) ' ,226( 4.2) , '247(2.9) ^271 '(4.9) ' 295 ( 4.6) 311 (3.4) 323 ( 6.5) ' 

' 200( 1.0) '• ‘214 (1.8) • 237 ( 1.7) ’’ 263 ,( lift) 200 ( 1.7) ‘ 307 ( 1 .9) ' , 319 L 1.6) ‘ 




GRADE 8 1992 
District of Columbia 

Northeast 

Nation 


‘‘<176'(,1.7) ,189(1.0) ‘ ‘209 ( 1^2) ' 233 (,1.8) 257,( 2.8),' 280 (.1.7) \ 298 (.3.4)' 

,205 ( 3.0) ■' ,217 ! ( 4.0) •'. :lM0 ( 3,1) _ • 266 ( 45) , '295 ( 4,4) “ .. 310 ('3.8) ' ,332 < 2.5) 

4 '205 (‘ 2.0) ; 218 ( 1.6) £ '/'241 ,('1j3) ■ , <267 ,'( 1.2) , '292 ( 1.0) 313 ( 1.4) . 325 < 1.5) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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* Recall that “about the same” means that the difference between these two groups, although it may appear large, is not statistically 
significant. 
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LEVELS OF MATHEMATICS ACHIEVEMENT 



Average proficiency on the NAEP scale provides an overall depiction of students* mathematics achievement; 
however, by itself, it does not describe what students know and are able to do in the subjects, nor does it 
evaluate student performance against a standard. This report next presents a set of results based on applying 
the National Assessment Governing Board’s standards to student performance on the mathematics scale. 

When Congress established the National Assessment Governing Board (NAGB) in 1988 to set policy for 
NAEP, it charged the board with “identifying appropriate achievement goals for each age and grade in each 
subject area to be tested under the National Assessment.” (Pub.L. 297-100, Section 3403 (a)(5)(B)(ii)). To 
carry out this responsibility, NAGB contracted with American College Testing (ACT) to undertake 
advisory and analytic functions that could assist the Board in forming its conclusions as to appropriate 
achievement levels to be used for evaluating the 1992 mathematics assessment results. Achievement levels 
are mappings of collective judgments about how students should perform onto the achievement scale. 12 
Boundary points were developed for three achievement levels for each grade — Basic, Proficient, and 
Advanced. Performance at the Basic level denotes partial mastery of the knowledge and skills that are 
fundamental for proficient work at each grade level. The central level, called Proficient, represents solid 
academic performance at each grade level tested. Students reaching this level demonstrate competency over 
challenging subject matter and are well prepared for the next level of schooling. Achievement at the 
Advanced level signifies superior performance at each of the grades tested. 

In previous NAEP reports, a procedure known as scale anchoring was used to interpret or provide meaning 
to the scores. 1 3 Anchor points are not based on judgments of how much students should know or be able 
to do, and they do not differ by grade level. Instead, scale anchoring provides empirical descriptions of the 
types of procedural knowledge, mathematical skills, and problem-solving abilities that students need to 
answer items correctly at that level. These descriptions are based on a close examination by mathematics 
experts of the characteristics of the mathematics items that best discriminate those students performing at 
or near each of the anchor points from those performing at the next lower level. Unlike the 
achievement -level approach, the scale-anchoring procedure leaves to the reader the judgment as to whether 
the achievement demonstrated was adequate in terms of what students should be able to do. Table SI in 
the Scale Anchoring Appendix of this report presents the percentages of students at or above each of the 
four anchor points (200, 250, 300, and 350 on the NAEP scale) for the total population and for selected 
population subgroups. A companion report, entitled Interpreting NAEP Scales , describes the development 
over the last two decades of various procedures for reporting NAEP data and explains the meaning and 
interpretation of the NAEP scales. 



12 The Achievement Levels Appendix briefly describes the process of gathering expert judgments about Basic, Proficient, and 
Advanced performance — as defined by NAGB policy — on each mathematics item, combining the various judgments on the 
various items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these levels. 

13 The Scale Anchoring Appendix provides definitions of each of four anchor points (200, 250, 300, and 350 on the NAEP scale) 
and briefly describes the process of identifying items that discriminate among students performing at adjacent levels and 
generalizing about the skills exemplified by those items. 
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This report follows NAGB’s policy that achievement levels should be the primary and initial method of - 
presenting the results of the 1992 Trial State Assessment. In this report, these achievement levels not only 
are applied to the 1992 data, showing the proportions of students that achieve the three achievement levels, 
they also are applied to data from the 1990 mathematics assessment, permitting a report on changes in 
percentages of students at or above each of the achievement levels. 14 



Definitions of the three levels of mathematics achievement are given in Figure 2. Table 4 provides the 
percentages of students at or above each of these achievement levels, as well as the percentage of students 
below the Basic level. 



Grade 4 
1992 



About one quarter of the students in public schools in the District of Columbia 
(25 percent), versus 59 percent in the nation, are at or above the Basic level. Relatively 
few of the students in the District of Columbia (6 percent), versus 18 percent in the 
nation, are at or above the Proficient level. Relatively few of the students in the District 
of Columbia (1 percent), versus 2 percent in the nation, are at or above the Advanced 
level. 



}de 8 i About one quarter of the public-school students in the District of Columbia (26 percent), 
1992 | versus 61 percent in the nation, are at or above the Basic level, while relatively few of the 
~ students in the District of Columbia (6 percent), versus 23 percent in the nation, are at 
or above the Proficient level, and relatively few of the students in the District of Columbia 
(1 percent), versus 3 percent in the nation, are at or above the Advanced level. 



Grade 8 I Compared to 1990, there was an increase in the percentage of students in the District of 

1990 vs 1992 j Columbia at or above the Basic level (26 percent in 1992 compared to 21 percent in 

1990), no significant difference in the percentage of students at or above the Proficient 
level (6 percent in 1992 compared to 4 percent in 1990), and no significant difference in 
the percentage of students at or above the Advanced level (1 percent in 1992 compared 
1 percent in 1990). 




14 The 1990 achievement levels used in this report reflect changes in the processes used to develop the original 1990 achievement 
levels. In consequence, the 1990 findings presented here differ from the results published earlier by NAGB in its report by Mary 
Lyn Bourque and Howard H. Garrison, entitled The Levels of Mathematics Achievement: Initial Performance Standards for the 
1990 NAEP Mathematics Assessment. (Washington, DC: National Assessment Governing Board, 1991). 
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FIGURE 2 |i Levels of Mathematics Achievement 



t. . • 

GRADE 4 




Trial State Assessment 



NAEP content areas: (1) Numbers and Operations; (2) Measurement; (3) Geometry; (4) Data Analysis, 
Statistics, and Probability; (5) Algebra and Functions. (Note: At the fourth-grade level, algebra and 

functions are treated in informal and exploratory ways, often through the study of patterns.) 



Skills are cumulative across levels -- from Basic to Proficient to Advanced. 



BASIC 

llliljglll 


Fourth-grade students performing at the Basic level should show some evidence of understanding 
the mathematical concepts and procedures in the five NAEP content areas. In relation to the NAEP 
scale, Basic-level achievement for fourth grade Is defined by proficiency scores at or above 211. 


Specifically, fourth graders performing at the Basic level should be able to estimate and use basic facts to perform simple 
computations with whole numbers, show some understanding of fractions and decimals, and solve simple real-world problems in all 
NAEP content areas. Students at this level should be able to use -- though not always accurately - four-function calculators, rulers, 
and geometric shapes. Their written responses are often minimal and presented without supporting information. 


pRliiHiii 
llllLEVEL -f.5 


Fourth-grade students performing at the Proficient level should consistently apply integrated 
procedural knowledge and conceptual understanding to problem solving in the five NAEP content 
areas. In relation to the NAEP scale, Proficient-level achievement for fourth grade is defined by 
proficiency scores at or above 248. 



Specifically, fourth graders performing at the Proficient level should be able to use whole numbers to estimate, compute, and 
determine whether results are reasonable. They should have a conceptual understanding of fractions and decimals; be able to solve 
real-world problems in all NAEP content areas; and use four-function calculators, rulers, and geometric shapes appropriately. 
Students at the Proficient level should employ problem-solving strategies such as identifying and using appropriate information. 
Their written solutions should be organized and presented both with supporting information and explanations of how they were 
achieved. 



Fourth-grade students performing at the Advanced level should apply integrated procedural 
AI^ knowledge and conceptual understanding to complex and nonroutine real-world problem solving in 

SSW ffve NAEP content areas. In relation to the NAEP scale, Advanced-level achievement for fourth 

( 7; g ;J[K M V; ;j grade is defined by proficiency scores at or above 280. 



Specifically, fourth graders performing at the Advanced level should be able to solve complex and nonroutine real-world problems 
in all NAEP content areas. They should display mastery in the use of four-function calculators, rulers, and geometric shapes. These 
students are expected to draw logical conclusions and justify answers and solution processes by explaining why, as well as how, they 
were achieved. They should go beyond the obvious in their interpretations and be able to communicate their thoughts clearly and 
concisely. 
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Grade 4 Basic-Level Example Item 



Refer to the rectangle below. (NOTE: Size reduced from original.) 



Percent Correct 


State 


isiiii 


Nation 


111111188 



Use your centimeter ruler to make the following measurement to the nearest centimeter. 
What is the length in centimeters of one of the longer sides of the rectangle? 

Answer: (8 centimeters) 



Grade 4 IVoficient-Level Example Item 




Carol wanted to estimate the distance from A to D along the path shown on the map below. 
She correctly rounded each of the given distances to the nearest mile and then added them. 
Which of the following sums could be hers? 



A 



A. 4 + 6 + 5 = 15 

B. 5 + 6 + 5 = 16 

*C. 5 + 6 + 6 = 17 

D. 5 + 7 + 6 = 18 




Percent Correct 


State 


liiMSIi 


Nation 


Illilll 



IjilraiiteM Example Item 



If Q represents the number of newspapers that Lee delivers each day, 

which of the following represents the total number of newspapers that Lee delivers in 5 days? 



A.5 + 0 
*B. 5 x [] 
C[>5 
D-(D + D)x5 



43 
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State 
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Nation 
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1992 




Trial State Assessment 



GRADE 8 



NAEP content areas: (1) Numbers and Operations; (2) Measurement; (3) Geometry; (4) Data Analysis, 
Statistics, and Probability; (5) Algebra and Functions. 



Skills are cumulative across all levels — from Basic to Proficient to Advanced. 



|lj LEVEL;: 


Eighth-grade students performing at the Basic level should exhibit evidence of conceptual and 
procedural understanding in the five NAEP content areas. This level of performance signifies an 
understanding of arithmetic operations - including estimation - on whole numbers, decimals, 
fractions, and percents. In relation to the NAEP scale, Basic-level achievement for eighth grade is 
defined by proficiency scores at or above 256. 


Eighth graders performing at the Basic level should complete problems correctly with the help of structural prompts such as 
diagrams, charts, and graphs. They should be able to solve problems in all NAEP content areas through the appropriate selection 
and use of strategies and technological tools, including calculators, computers, and geometric shapes. Students at this level should 
also be able to use fundamental algebraic and informal geometric concepts in problem solving. 

As they approach the Proficient level, these students should be able to determine which of available data are necessary and sufficient 
for correct solutions and use them in problem solving. However, eighth graders at the Basic level show limited skill in 
communicating mathematically. 


PROFICIENT 


Eighth-grade students performing at the Proficient level should apply mathematical concepts and 
procedures consistently to complex problems in the five NAEP content areas. In relation to the 
NAEP scale, Proficient-level achievement for eighth grade is defined by proficiency scores at or 
above 294. 


They should be able to conjecture, defend their ideas, and give supporting examples. They should understand the connections 
between fractions, percents, decimals, and other mathematical topics such as algebra and functions. Students at the Proficient level 
are expected to have a thorough understanding of Basic-level arithmetic operations - an understanding sufficient for problem 
solving in practical situations. 

Quantity and spatial relationships in problem solving and reasoning should be familiar to them, and they should be able to convey 
underlying reasoning skills beyond the level of arithmetic. They should be able to compare and contrast mathematical ideas and 
generate their own examples. These students should make inferences from data and graphs, apply properties of informal geometry, 
and accurately use the tools of technology. Students at this level should understand the process of gathering and organizing data 
and be able to calculate, evaluate, and communicate results within the domain of statistics and probability. 


^ADVANCED'' 1 

....... {;| ^ <' “ . ! . 


Eighth-grade students at the Advanced level should be able to reach beyond the recognition, 
identification , and application of mathematical rules in order to generalize and synthesize concepts 
and principles in the five NAEP content areas. In relation to the NAEP scale, Advanced-level 
achievement for eighth grade is defined by proficiency scores at or above 331. 



They should be able to probe examples and counter-examples in order to shape generalizations from which they can develop models. 
Eighth graders performing at the Advanced level should use number sense and geometric awareness to consider the reasonableness 
of an answer. They are expected to use abstract thinking to create unique problem-solving techniques and explain the reasoning 
processes underlying their conclusions. 
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Which of the following is both a multiple of 3 and a multiple of 7? 

A. 7,007 - - • 

B. 8,192 
*C. 21,567 

D. 22,287 

E. 40,040 

Did you use the calculator on this question? 

Yes No 



Percent Correct 


State 


iiipili 


Nation 


|,:76 



:: ''Grade '8 Proficient-Level Example Item 




80 




70 


• 

• • 
• 


Number 60 


• 


of 50 


• 


Sit-ups 40 


* . 
• m 


30 


• • 





10 15 20 25 30 
Age in Years 

In the graph above, each dot shows the number of sit-ups and the corresponding age for one 
of 13 people. According to this graph, what is the median number of sit-ups for these 13 people? 



A. 15 

B. 20 

C. 45 
*D. 50 

E. 55 

Did you use the calculator on this question? 

Yes No 



Percent Correct 


State 


mmm t 


Nation 


23 <1.4) ' 
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Grade 8 Advanced- Lod Example Item 






A 


B 


2 


5 


4 


9 


6 


13 


8 


17 



14 



If the pattern shown in the table were continued, what number would appear in the box at the 
bottom of column B next to 14? 



A. 19 

B. 21 

C. 23 

D. 25 
*E. 29 



Percent Correct 


State 


111118 I: 




Nation 
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TABLE 4 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 



Grade 4 


Grade 8 


1992 


1990 


1992 



Achievement Level 



At or Above Advanced Level District of Columbia 

Northeast 

Nation 

At or Above Proficient Level District of Columbia 

Northeast 

Nation 



At or Above Basic Level District of Columbia 

Northeast 

Nation 



Below Basic Level 



District of Columbia 

Northeast 

Nation 





Percentage 1||1 


Percentage 


• 1 (0.2) 
§S!P(o.8y : . 
£-;~2 ( o.a)y.> 


. 3(i.o) 1 

2 ( 0.4) 


. :i ( 0 . 2 ) 

S&B&KtWhK 

: , 3 ( 0 : 5 ) 


6 ( O. 3 JIII 8 I! 
| ; • ' 


4(0.7) 

' 26 (, 3 . 1 ) • 


, 23 ( 1 . 1 ) > 


-84;(:&on: a 'f 

59 ( 1.1) 


jsT: 

6 s f ( -3.7) 


.26 (iiSiii 

■ 59 ( 3.9)"; 

/;■ ,,! 6l-(i1.2) ■; 


;75< 1.0) 
36 (i3.0> 


i-i: 79(1.0) 

*,,35,(!3.7‘). v 1 !:' ,.!• 

43(1.4) 


,;:|ilii'4i;!|;3;9): t 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 



Clearly, many students in the District of Columbia fail to meet or exceed the achievement levels that 
prescribe what students should know and should be able to do. Educators and policymakers will need to 
look to many sources of information and opinion for explanations of these levels of performance. Among 
the possible explanations, several factors should not be overlooked. First, students may not be learning 
enough in school to reach the achievement levels. In 1983, the National Commission on Excellence in 
Education warned that “the educational foundations of our society are being eroded by a rising tide of 
mediocrity that threatens our very future.” 15 In 1990, the President and the Governors committed the 
Nation to six goals for education, the third of which called for American students to “leave grades four, eight 
and twelve having demonstrated competency in challenging subject matter.” The political leaders of this 
Nation are dissatisfied with the performance of American students. These NAEP findings confirm that a 
great many American students are not yet performing at the high standards embodied in the achievement 
levels. 



15 National Commission on Excellence in Education, A Nation at Risk. (Washington, DC: U.S. Department of Education, 1983). 
In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades has been arrested, and we have 
begun the long climb back to reasonable standards.” (p. 1 in American Education: Making it Work. (Washington, DC: U.S. 
Department of Education, 1988).) A 7 
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Second, some students may not be reaching the higher achievement levels because schools may not be 
teaching the elements of mathematics that are included on the NAEP assessment, and because the 
assessment may not be covering some elements of mathematics included in the school curriculum. No 
assessment or test can cover all the different areas of mathematics that are taught in school. The content 
coverage of the NAEP mathematics assessment was set by a consensus approach. Teachers, curriculum 
specialists, subject matter specialists, local school administrators, parents, and members of the general public 
actively participated in deciding what are the most important elements of mathematics to be included in the 
assessment and for students to learn. 16 Since 1990, the content coverage of the NAEP mathematics 
assessment has been moving toward closer alignment with the curriculum and evaluation standards 
recommended by the National Council of Teachers of Mathematics (NCTM). 17 The 1992 assessment has 
a greater emphasis on geometry and algebra and functions and less emphasis on numbers and operations 
than assessments prior to 1990. Included among the items are some constructed-response problem-solving 
questions that assess higher-level thinking skills that multiple-choice question formats cannot normally 
measure. The 1994 assessment will be even more closely aligned with the NCTM standards. Other 
evidence from NAEP, presented later in this report, indicates that many schools and teachers have not yet 
begun to follow the approach to teaching mathematics recommended by NCTM. 

Third, the Basic, Proficient, and Advanced achievement levels reflect high performance standards for the 
1992 NAEP mathematics scale. The establishment of achievement levels depends on securing a set of 
informed judgments of expectations for student educational performance and on summarizing the individual 
ratings into collective judgments. These expectations reflect the Board’s policy definitions, which require 
that students at the central, Proficient level demonstrate “competency over challenging subject matter.” 
The resulting standards are rigorous. The higher any standard is set, the fewer students will be able to reach 
that standard. 

As measures of performance, both average proficiency scores and percentages of students who score above 
the critical achievement levels on the NAEP scale provide a valuable overall depiction of students’ 
mathematics achievement. In order to present a closer look at how well students know particular areas of 
mathematics, the next section presents student performance in five content areas and Estimation. 



16 NAEP Mathematics Consensus Project. Mathematics Framework for the 1992 National. Assessment of Educational Progress. 
(Washington, DC: National Assessment Governing Board, 1992). 

17 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 

1989). ... * 
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CONTENT AREA PERFORMANCE 



As previously indicated, the questions comprising the Trial State Assessment covered the content areas of 
Numbers and Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra 
and Functions; as well as Estimation skills. Estimation was measured using a special paced audiotape that 
limited the amount of time students had to work on each question and made any direct calculations of 
answers difficult. The information from the Estimation section is intended to supplement the data obtained 
from the Numbers and Operations and the Measurement questions administered using the more traditional 
paper-and-pencil or calculator approaches. Table 5A (average proficiency) and Table 5B (percentile 
distribution) provide the District of Columbia, Northeast, and national results for each area. 



Grade 4 
1992 



Students in the District of Columbia performed lower than students in the nation in all 
of the six areas. 



Grade 8 Students in the District of Columbia performed lower than students in the nation in all 
1992 of the six areas. 



Grade 8 Estimation was not included in the 1990 Trial State Assessment program. Therefore, 

1990 vs 1992 change in eighth-grade performance is provided only for the five content areas. There 

was an improvement in student performance from 1990 to 1992 in the District of 
Columbia in Numbers and Operations and Data Analysis, Statistics, and Probability. 
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TABLE 5A | Fourth-Grade and Eighth-Grade 

I Public-School Content Area Performance 



Grade 4 


Grade 8 


1992 


1990 


1992 



Numbers and Operations 

District of Columbia 

Northeast 

Nation 


ijSlh :!^roflcieney ill 

( 0 7) 

: t 220 ( 2.2), !: 

IliffiSiSfr?} Ililll 


l!|i; Proficiency|||j 

:;f4; 266 -(<e 1 pP|§!:; 


III ProftcIency|;;j 

1|1B 243 <( 0.8} > 

pi! 274:;i(i!2:7)flS|iiii 

III 270 l 0.9) >/ 8 


Measurement 

District of Columbia 

Northeast 

Nation 


\227 (2.3}. ; ; ;\r 
:te ; ^222 ( 0.9) 


^222^1} 1 
;P:;:r26^(4.2)':i i ::; < 4;| 


: V 265 : (< 3.9):i ; !'5:;!i|: 


Geometry 

District of Columbia 

Northeast 

Nation 


: Pj 224 2.2) / 511 
•C ,220 ( 0.7) « i | 


Y;259(‘i:4}' v <‘‘\ 




Data Analysis, Statistics, and Probability 

District of Columbia 

Northeast 

Nation 


fcMIlifts) 

W -218 ( 1.0) 


;-"^ : ->273 ('3.9)Yfo { 

262(1.6) ‘V 


1 269 (ifiijiiiii'r 
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Algebra and Functions 

District of Columbia 

Northeast 

Nation 


^$‘491 '(0.7) 

* 1 ‘‘ * 222 ( 212) 1 ; 1 
a ‘j {[ 216 ( 0.9);,,;- 


235 ( 1.1) 

l26oyi.3).;yY;:3 
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Estimation Skills 

District of Columbia 

Northeast 

Nation 


. ; i7i ( i.o) ‘ 

\ ‘206 *3 ‘-8)1^** 




( o.8)\‘li;iSI 

;t!!! ; 269 { ( !, 5.1 )' rV; ; 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — Estimation was not included in the 1990 Trial State Assessment. 
! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Content Area 



Trial State Assessment 
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25th 


50th 
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90th 


95th 




Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 1992 
Numbers and Operations 

District of Columbia 

Northeast 

Nation 

Measurement 

District of Columbia 

Northeast 

Nation 

Geometry 

District of Columbia 

Northeast 

Nation 

Data Analysis, Statistics, 
and Probability 

District of Columbia 

Northeast 

Nation 

Algebra and Functions 

District of Columbia 

Northeast 

Nation 

Estimation Skills 

District of Columbia 

Northeast 

Nation 



GRADE 8 1990 
Numbers and Operations 

District of Columbia 

Northeast 

Nation 

Measurement 

District of Columbia 

Northeast 

Nation 

Geometry 

District of Columbia 

Northeast 

Nation 

Data Analysis, Statistics, 
and Probability 

District of Columbia 

Northeast 

Nation 

Algebra and Functions 

District of Columbia 

Northeast 

Nation 

Estimation Skills 

District of Columbia 

Northeast 

Nation 
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GRADE 8 1992 
Numbers and Operations 

District of Columbia 

Northeast 

Nation 

Measurement 

District of Columbia 

Northeast 

Nation 

Geometry 

District of Columbia 

Northeast 

Nation 

Data Analysis, Statistics, 
and Probability 

District of Columbia 

Northeast 

Nation 

Algebra and Functions 

District of Columbia 

Northeast 

Nation 

Estimation Skills 

District of Columbia 

Northeast 

Nation 



TABLE 5B 
(continued) 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Content Area 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — Estimation was not included in the 1990 Trial State Assessment. 
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CHAPTER 2 

Mathematics Performance by Subpopulations 

Many of the reforms recommended for mathematics education have emphasized the need to stress 
mathematics for all students. 18 Nevertheless, assessment results consistently show lower achievement for 
subpopulations of students who are less advantaged than their classmates. 19 The 1992 Trial State 
Assessment sheds further light on this by reporting on the performance of various subgroups of the student 
population defined by race/ethnicity, type of community, parents’ education level, and gender. 



RACE/ETHNICITY 



The Trial State Assessment results can be compared according to racial/ethnic groups when the number of 
students in a racial/ethnic group was sufficient in size to be reliably reported (at least 62 students). 

Table 6A (average proficiency) and Table 6B (percentile distribution) present fourth-grade mathematics 
performance results for White, Black, and Hispanic students, and eighth-grade mathematics performance 
results for Black and Hispanic students from the District of Columbia. 



In the District of Columbia: 



Grade 4 
1992 



White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. 



Grade 8 
1992 



Black students demonstrated about the same average mathematics proficiency as did 
Hispanic students. 



Grade 8 
1990 vs 1992 



The performance of Black and Hispanic students stayed about the same from 1990 to 
1992. 



18 Everybody Counts: A Report to the Nation on the Future of Mathematics Education , Lynn Steen, Ed. (Washington, DC: 
National Research Council, National Academy Press, 1989). 

19 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement : NAEP’s 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 
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TABLE 6A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Race/Ethnicity 



Grade 4 


Grade 8 


1992 


1990 


1992 



District of Columbia 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic, *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 6B 



GRADE 4 1992 
White 

District of Columbia 

Northeast 

Nation 

Black 

District of Columbia 

Northeast 

Nation 

Hispanic 

District of Columbia 

Northeast 

Nation 



GRADE 8 1990 
White 

District of Columbia 

Northeast 

Nation 

Black 

District of Columbia 

Northeast 

Nation 

Hispanic 

District of Columbia 

Northeast 

Nation 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Race/Ethnicity 



Trial State Assessment 


5th 


10th 


25th 


50th 


75th 


90th 


95th 




Percentile 


Percentile 


Percentile 


Percentile 
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Percentile 
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table 6B Percentiles of Mathematics Proficiency in 
(continued) Fourth- and Eighth-Grade Public Schools 
by Race/Ethnicity 



5th 


10th 


25th 


50th 


75th 


90th 


95th 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 8 1992 
White 

District of Columbia 

Northeast 

Nation 

Black 

District of Columbia 

Northeast 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within db 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 
students). 



Table 7 presents mathematics performance by achievement levels. For the District of Columbia: 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



About half of the White students (52 percent), relatively few of the Black students 
(3 percent), and relatively few of the Hispanic students (2 percent) were at or above the 
Proficient level. 

Relatively few of the Black students (4 percent) and relatively few of the Hispanic 
students (7 percent) were at or above the Proficient level. 

About the same percentage of Black and Hispanic students were at or above the 
Proficient level in 1992 as in 1990. 
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Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Race/Ethnicity 



Trial. State Assessment . 
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the ration’s table 7 Levels of Fourth-Grade and Eighth-Grade 

RE rARn Nfl (continued) Public-School Mathematics Achievement 

I by Race/Ethnicity 



Trial State Assessment 


Grade 4 


Grade 8 




1992 
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1992 


Below Basic Level 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. ! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



TYPE OF COMMUNITY 



Table 8A (average proficiency) and Table 8B (percentile distribution) present the mathematics proficiency 
results for fourth-grade students attending public schools in advantaged urban areas, disadvantaged urban 
areas, and areas classified as “other” and for eighth-grade students attending public schools in advantaged 
urban areas, disadvantaged urban areas, and areas classified as “other”. (These are the “type of community” 
groups in the District of Columbia with student samples large enough to be reliably reported.) 



In the District of Columbia: 




Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban areas 
or areas classified as “other”. 

Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban areas 
and about the same mathematics proficiency as did students attending schools in areas 
classified as “other”. 

The performance of students in areas classified as “other” was higher in 1992 than it was 
in 1990. Students in advantaged urban areas and disadvantaged urban areas performed 
about the same in 1992 as in 1990. 
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TABLE 8A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Type of Community 



Grade 4 


Grade 8 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within dfc 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



Table 9 presents mathematics performance by achievement levels. In the District of Columbia: 



Grade 4 I 
1992 1 



Some of the students attending schools in advantaged urban areas (17 percent), relatively 
few of the students in disadvantaged urban areas (2 percent), and relatively few of the 
students in areas classified as “other” (8 percent) were at or above the Proficient level. 



Grade 8 Some of the students attending schools in advantaged urban areas (12 percent), relatively 
1992 few of the students in disadvantaged urban areas (1 percent), and some of the students 
in areas classified as “other” (16 percent) were at or above the Proficient level. 

A greater percentage of students in areas classified as “other” were at or above the 
Proficient level in 1992 than in 1990. About the same percentage of students in 
advantaged urban areas and disadvantaged urban areas were at or above the Proficient 
level in 1992 as in 1990. 



Grade 8 
1990 vs 1992 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Type of Community 
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Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Type of Community 



Trial State Assessment 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. 



PARENTS’ EDUCATION LEVEL 



Previous NAEP findings have shown that students whose parents are better educated tend to have higher 
mathematics proficiency. Table 10A (average proficiency) and Table 1 OB (percentile distribution) show 
the mathematics proficiency results for fourth-grade public-school students who reported that at least one 
parent graduated from college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, and they did not know their parents’ 
education level; and for eighth-grade public-school students who reported that at least one parent graduated 
from college, at least one parent had some education after high school, at least one parent graduated from 
high school, neither parent graduated from high school, and they did not know their parents’ education 
level. (These are the groups with student samples large enough to be reliably reported.) In the District of 
Columbia: 



Grade 4 
1992 



Students who reported that at least one parent graduated from college demonstrated 
about the same average mathematics proficiency as did students who reported that at least 
one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 
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Grade 8 j Students who reported that at least one parent graduated from college demonstrated 

1992 j about the same average mathematics proficiency as did students who reported that at least 

one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 

Students who reported that at least one parent graduated from college, at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level performed about the same in 1992 as in 1990. 
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Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Parents’ Education 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Parents’ Education 
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GRADE 8 1992 
College graduate 

District of Columbia 

Northeast 

Nation 

Some college 

District of Columbia 

Northeast 

Nation 

High school graduate 

District of Columbia 

Northeast 

Nation 

High school non-graduate 

District of Columbia 

Northeast 

Nation 

I don’t know 

District of Columbia 

Northeast 

Nation 



fi.82 (• 5-8)IK 

212 < 9,0) < 


!!»;:( .4 0) ! 
. V23Q ( a.4) j 


IfSISpI*) v 
7,5) 
2.7) 


?i»7 ! (£2.8) 


: -269( 3l)lf 
1 313 < 3.6) 1 
;!j: :: 305 < 2.4) . 


297 (4.6)" 

mm is) 

0% $5) 


i|!314l<;i5.2)!l 
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Si 83 pSfi 
H2& mm 
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"226 ( 2.0) '! 


SSI 2 I 8 l2J)r 

‘ ‘248 ( 1.8) ■' 


:::24i:!{ 1.5) 
ili‘26B { 3le) ' ! 
‘‘269 ( 2.4) ' 


264 ( 3.djll 
£90 ( 1,8) 
293 ( 1.41 


I. .263 ( 47) 
fijOijl { 3 J5) II 


• ( ;325:( 2.6) f 




'‘'‘183(6X1)' « 
ii : 2i7l($:3j ! 
{ 2,6J t : ; 


,<202 {‘'27)1 
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y ;2^Ct;2),| 


' ! 224 (23), 
■'ll ; 259 (: 6.7)11 
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|p2^f;®il 

S?284 (;:&2)3i 


i‘."<29$> ( : 2.0) | 


; '280 ( 2,6) ! 
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|pi;245 ('3.6),' i 


248 .( 4.3)/ '' 
V' : 265 (11,8);! .: 
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|| 291 


; !;5iSblpiS® 

7' ,< 3Q2T i 5.l) :: j 


11 
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!® : 206;!( 3.2J, ‘ 
lift 206 1 3.6). 


:207f(: 1 , 5 ) ' ; 

|l228!:f;'3;6)li 

1 - 227 ( 2,8) | 


:|-229 (. 33 ) , ■ 
'i249 ;(;-4.8)1|l 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 
students). 



Table 11 presents mathematics proficiency by achievement levels. In the District of Columbia: 



Grade 4 
1992 



Grade 8 
1992 



Achievement was at or above the Proficient level for 9 percent of the students who 
reported that at least one parent graduated from college, 7 percent of the students who 
reported that at least one parent had some education after high school, 2 percent of the 
students who reported that at least one parent graduated from high school, 1 percent of 
the students who reported that neither parent graduated from high school, and 3 percent 
of the students who reported that they did not know their parents’ education level. 

Achievement was at or above the Proficient level for 11 percent of the students who 
reported that at least one parent graduated from college, 4 percent of the students who 
reported that at least one parent had some education after high school, 2 percent of the 
students who reported that at least one parent graduated from high school, 3 percent of 
the students who reported that neither parent graduated from high school, and 3 percent 
of the students who reported that they did not know their parents’ education level. 



Grade 8 
1990 vs 1992 



About the same percentage of students who reported that at least one parent graduated 
from college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level were at or above the Proficient level in 1992 as in 
1990. 
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District of Columbia 




Trial State Assessment 



TABLE 1 1 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Parents’ Education 



Grade 4 


Grade 8 


1992 


1990 


1992 



At or Above Advanced Level 


Percentage 


^ K.. # ^ % i «|| II. *f I il: ? Il il: ill 

t ; Percentage = ; Percentage ’ 


District of Columbia 


" '}(' ‘ " « s Vi * ' ' <. 
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r 0 (.'0.0) '■ :• ' 0 ( 0.0) ' • ' 
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' ' if* "<1f * * ‘ v V-iV'l:!' V 
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! lipliiij |v: :l;:: I'ijiQ (o.5) '• < : { % 


1 don’t know 
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v M ^ 2 3) *• * 1 
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District of Columbia 
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District of Columbia 
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ifllllij 
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TABLE 1 1 
(continued) 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Parents’ Education 



Grade 4 


Grade 8 


1992 


1990 


1992 



Below Basic Level 








go 


District of Columbia 






' '' 1 . ‘ 






Graduated college 










Some education after high school 


*- V;^«9f4.2) : .C : 7 


4 { 3-3) • / 


•\ 1 . e? ( : ; { \ 




Graduated high school 
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Did not finish high school 






83 ( 4.6)8 i^v; 




1 don’t know 




m ( ^|tt|||||l| 


3.i) f 1 ; 
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s k * *'-?]! l ■iSlijf 




• t { * j * « * ' « * 
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ryr^fi'is) • f 


ill# liflU) ' ^ 
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i:F*39f8^) U / 




Graduated high school 




47 (!; BAy t ;;1‘S 
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+** l±* 


WSm mm 




1 don’t know 


11 


'■ ‘"v* jvj 
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•!• j » * fel y' \ ‘ •• v- ' <: 
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f i ‘ 








Some education after high school 
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1^:Sr4iS=( 








Did not finish high school 


mmiXKm 








1 don’t know 


.48(1^) ; 


'1 *y. «8’( 


! 57(2.5) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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District of Columbia 



GENDER 



Table 12A (average proficiency) and Table 12B (percentile distribution) provide the mathematics 
proficiency results by gender. 



• In the District of Columbia, in both fourth grade and eighth grade, there appears to be no 
significant difference in the average mathematics proficiency of males and females attending 
public schools. 

• In the District of Columbia, the average mathematics proficiency for eighth-grade females 
in 1992 was about the same as the average mathematics proficiency for eighth-grade females 
in 1990. The average mathematics proficiency for eighth-grade males in 1992 was about the 
same as the average mathematics proficiency for eighth-grade males in 1990. 



THE NATION’S 
REPORT 
CARD 



1992 



IS; 



Trial State Assessment 



TABLE 12A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Gender 



Oracle 4 


Grade 8 


1992 


1990 


1992 







Proficiency r 


Proficiency 


Proficiency |;|| 


District of Columbia 




ills 






Male 


IS! 1 




Female 


IK- 


< v ‘ c ; 




Northeast 


Male 


225 ( 2.3) 




If !B;if • 267i;|:2;9) ' • • , . 
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illll :? 20 ( 2*) < { ‘ <f « 


269(3.2) 
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' * 


' 262 ( i.7) 


'* '266 (SP>llllllll 




Female 


■g; 







The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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TABLE 12B 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Gender 



5th 


10th 


25th 


50th 


75th 


90th 


95th 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 1992 
Male 

District of Columbia 

Northeast 

Nation 

Female 

District of Columbia 

Northeast 

Nation 



GRADE 8 1990 
Male 

District of Columbia 

Northeast 

Nation 

Female 

District of Columbia 

Northeast 

Nation 



GRADE 8 1992 
Male 

District of Columbia 

Northeast 

Nation 

Female 

District of Columbia 

Northeast 

Nation 
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mm 

9 Cl. $) J 


ififeio '! 

f 941 


W&Sk'l 2.4) ‘j 
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8 294 ( 6.1) ' 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 



Table 13 presents mathematics performance by achievement levels. 

• There was no significant difference between the percentages of fourth-grade males and 
females in the District of Columbia who were at or above the Proficient level (5 percent for 
females and 6 percent for males). In addition, there was no significant difference between 
the percentages of eighth-grade males and females in the District of Columbia who were at 
or above the Proficient level (6 percent for females and 5 percent for males). 

• Also in the District of Columbia, about the same percentage of eighth-grade males were at 
or above the Proficient level in 1992 as in 1990. About the same percentage of eighth-grade 
females were at or above the Proficient level in 1992 as in 1990. 
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TABLE 13 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Gender 



Grade 4 


Grade 8 


1992 


1990 
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At or Above Advanced Level 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 



CONTENT AREA PERFORMANCE 



Tables 14A-14F provide a summary of content area performance by race/ethnicity, type of community, 
parents’ education level, and gender. 
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TABLE 14A 



Fourth- and Eighth-Grade Public-School 
Performance in Numbers and Operations 
by Subpopulation 



Grade 4 


Grade 8 


1992 


1990 


1992 



TOTAL 






| , Proftetency ■ • 






District of Columbia 


^ W(az)' * 








Northeast 


>:‘v- ^0^2.2). ‘ < tl ‘ 


% 272 < 2^P:51 i 


ill 271 22}Mzf 




Nation 






i;.p7p c ( 0«9) 


RACE/ETHNICITY 




c ( > , , 


»Oj ' 7 -t ( * < *, 




White 


District of Columbia 


, -23fc ( 5.0) / “ t S 








Northeast 


vV, 


<31 ; : ;‘276 : J 


4Bi2ei:.d^oiS|> 




Nation 


III ;223<jl;1}’ Ijll 


; Ijf 


i|Si27Si ( 


Black 


District of Columbia 


llip»0^) II 


lilSlp.9)' ‘ ■; • • = 






Northeast 




Slilp2$2 ( e.9)i • 3|i l|l 


'■ ? 246 ( 3^6} 




Nation 








Hispanic 


District of Columbia 


76 I! 


- 226 ilpi|liia! 1 


i'-ij®, 234ij( 3.6) V . 




Northeast 










Nation 


: kft: i96j 2.o}‘‘. | g 


llB8iSd|?lpi|| Si 




TYPE OF COMMUNITY 




»'"r Lj.1. , 5 , J ... x 1 


4 f’jij *i. 


( f{ . { '{‘ { *• <tf { l ‘ c 


Advantaged urban 


District of Columbia 


< isjviltl 


262lSS^|:illl 3S 


‘ 260 ( aifilllli 




Northeast 


• ‘ivy wW i.O}! 'i r 


•y *283< 7 . 9 ) 1 .'' 


:: ; 292lpS:8)i:?®1pilB i : 




Nation 


aaas 1 3.o^ ! ' s ' 


■jS 284 , (,3.9}l': .', -j.\. ? ■ 




Disadvantaged urban 


District of Columbia 


.1} % '4$ 








Northeast 




; ' ,{ ' !i V 


240.p!3.7)!plls| 




Nation 








Other 


District of Columbia 




A240t2.3}';,::- 


;i’257,''l- , 2.3)i 'SA l t 




Northeast 






,271 ( 2.8) V • ' 




Nation 




M 1 




PARENTS ’ EDUCATION 






lli h=T 




Graduated college 


District of Columbia 










Northeast 




; V 






Nation 




,;i 


d;V28T^i:3 


Some education after high school 


District of Columbia 




1. •; 


c { <ft >249;f‘2.7>M| [ fi 




Northeast 


/ 227 ( 5.0) 


y , ! ! 






Nation 




“ ' ’■ II 




Graduated high school 


District of Columbia 




;'"f2l92,(i.7) 






Northeast . 






ill283ii(p4lO) ' <1; 




Nation 


209 ( 1.9) , 


• j f; |, 259 ( 1iB)' 




Did not finish high school 


District of Columbia 


v-j. 


•:-.:r234. < a.i> . ;j 


"^234:^):^*-. 




Northeast 






1 1 '252 ( : 




Nation 


... ; i99p(lMifi|l( 


’■ ' t ’: : ‘i247 lz\) j 




1 don't know 


District of Columbia 


:• |i184 f f All 


SX ‘231 [2 A y:*r 51 






Northeast 


"1; *- 2121 2M)vr:xz> 








Nation 




5143 l|t‘3^4) ;y 




GENDER 




* L-4I.1- . p f ";!«£’ ; t-] ;V|‘\ 


•4 V <: f , :%i* * ‘ . ‘ ‘ ' 


<. ?■?'*,« i « ; c ‘“ ' ” 


Male 


District of Columbia 






j .-i24l)l4) ■ f ? 




Northeast 




1 V ‘ ‘273 j.3‘7).-v: f . <:•; K 


?«, 270 




Nation 


y&zvfH T‘ 




■•j 269 ( 1.1) ; , \l 


Female 


District of Columbia 




<: • ‘ Mi rO0)« , : ■! 


'■* <244 ( <1 .4) 




Northeast 


Sf 


‘ ' 272 ( '• ifl- 


II ? : 272 (!:3J2jElli|! 




Nation 


: - 1 : ' ’ ! - 5 


r j'iS,266,| !:1 4}'':.:: A” 


' i 5 l2i71 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14B 



Fourth- and Eighth-Grade Public-School 
Performance in Measurement by 
Subpopulation 



Grade 4 


Grade 8 


1992 


1990 


1992 



TOTAL 




II ‘ : Proficiency' |||| 


1|| Proficiency 1 1 


I:?; Proficiency : " 




District of Columbia 


ci M 


•:Wr' 222 ( 1.4) • if! 


Mm Sill; 




Northeast 


:t! >27 •( 2.3) 'M' 


iipter < 4.2) i 


■1. 265 ( 3.9} 111; 




Nation 


!A-;222 ( 0.9) {< -f 


!?|S258 (Leril'd ll 


v\ ! i;264 ( ‘i ^) ! :>- fi 


RACEfETHNICITY 




• llllill.- '"j! '<•.■■■ v 




White 


District of Columbia 






!|:’! i -4 y -: t 1', 




Northeast j 


|| \ ( 237:| 2.6) c v || 


illi ( S[b)?1|!:’I 1 


Wm ( S-i)!l I 




Nation 








Black 


District of Columbia 




:-l!i ; i'22l;’:(’SSi3) W$ S 


11 :;2l 9 (. ! 17) : 1; i 




Northeast 






IIII229 ( MM 




Nation 


• *. ( , mx i.7) «<; 




111225' ( fiojsri! 


Hispanic 


District of Columbia 


‘184 (2.9) 


ii i 


!|ll219:(l4.8),i;i!|il:4 


Northeast 


ill- t 2om^js)WM 


j,/.*':::;. *** *y'; V 5 1 ' 5 • 






Nation 


Wl; 12021(1.6}“ 






TYPE OF COMMUNITY 






VC V IuSa ^ ‘i* 'sj a | 




Advantaged urban 


District of Columbia 




■ 24#m0m s 


;^/aiaTU5-4):y 


Northeast 


;^249 s i4^)i 1 ! 


i 279 1 3.7)1 “ 






Nation 


246 ( 3.5)! . 


aa. 281 ( 4.8)1 I S' •; Li? 


ifii287 


Disadvantaged urban 


District of Columbia 


ijiiiiF v\\ 


2 i 8 iiipli):i. .• ■ iv 






Northeast 




%.a:;L237 , (ie.4,)!-;..v: ! ,. ; V 






Nation 


| j 7’Y t 194<('3.6} 1- ft 


Sa.-.'243 ( 4.8)1 IffeS ill 


iS|S2l9i!i mj&ji Pi 


Other 


District of Columbia 




1111226 ( 2.7) 


lvl'124 




Northeast 


Wlfc-224‘< 2.5)^ ;^ 


:i=V : ‘ 269 (.531)^' / i | 






Nation 


' 


. 258 ( 2.2) • 




PARENTS' EDUCATION 








Graduated college 


District of Columbia 




.;> ! :<,228 ( 2 't) ss, :!i! 


Northeast 




S ' 280 ( 5.0) I-, S Hj 


283 ( 5 Ap'.’:$- 




Nation 


/•Jfe 229 ( 1.4) ‘ iiJ 


• i‘ 272 ( 2.0)’. V' .r, 


279 (<<2.3) ll 


Some education after high school 


District of Columbia 


3 * 200 ( 4.2) 


226 (La.7) ;«v ;■ r 


j PPiP229:i( 3.1)/ v 


Northeast 


'11.235 ( 4:9) < Ip - 


^SiS262 ( 4.5)?|S3Si; !?• 


. ; 264 ( ;a.4) ; ‘ 1 




Nation 


il:pff228F( 1.9)1QM 


.V. ... '264 ( 2.1) '* • f 


;! :267* (•.ri)i:* l 1 


Graduated high school 


District of Columbia 


";l!S188(23)- m 


r '218 ( 2.1),?; 


ip2tG :j 3i0) .V 


Northeast 


: 1 221 ( 5.6) ‘ { 1 


i i" 257 ( 3.1) ? i . * i , 


« / 5 254 (••S.Spf ‘ ! ’- 




Nation 


' ■ 218, (1 *7} 


V- ' 249 ( 1.9)T : fi:' 


1251 1.8)‘: '■ 9. 


Did not finish high school 


District of Columbia 


; .189 ( 2.8}— ‘v 


: &'|>.2,16 ( 4.1) , I 


nHim!!l2 i b s ( 


Northeast 




, fM 236^7^)/ V.L.’! 


111238 ( 5.6)1 ! 




Nation 




111243 (•:2^)lP ,i i:- 


1 don’t know 


District of Columbia 


Mil 88 ( 2.0) l!|!i: 


213 ( 3.6) ‘ <<.“ 

,C { .'<#** ^*4 * ^ : 


v.2W 3WD--5. 




Northeast 


: -ir- 220 ; ( 22y:im 


l!if!:i246{ ! 4.5):-;!' 




Nation 


Q T ?&i7 ( o.9) . 






GENDER 








cjJ.« 


Male 


District of Columbia 




'lo , 223 (‘1>}V { : V i 


3111224 ( 2;7p|j.;‘ :i “ 




Northeast 


W :9B!8 


1 * '47H53) ‘‘ i‘“' ‘ 


33).: : 

1112661 ( ®):IIf§ 




Nation 


"••• 4 22^iii(iS!! jililiiii 


l|l 262 ( 2ri}'<; { : ‘ i 


Female 


District of Columbia 


||l 191 ( 1.0}* {t .v- L 


!tti ■ 22211*}".' ’ ’ 






Northeast 


\.c:^224i:( : 2;8) : -lSi 


262(4.0) ‘4, ‘ «! 


Iii262:(:4.8) 




Nation 


IliPII 


^ . *254f.1^ f! 


!t : 262 ( !7) i> ' .1 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14C 



Fourth- and Eighth-Grade Public-School 
Performance in Geometry by 
Subpopulation 



Grade 4 


Grade 8 


1992 


1990 


1992 







J: ; - 


11||0roficlency fl ; 


111 BIS ' Proficiencylli 


TOTAL 


District of Columbia 


’1= , 198.Vb.9)'p3! 


./229iM)lH 


P ill 231 ( 1.3} V- • 




Northeast 


■' £ 224,1 £. 2 )"' 


• |p6 ( 3.3), ‘ ] 


i;Y W& 263 ( 3Lij; : C B ' 




Nation 


|i : :#j220:( 07)ll:£f 


v;fr; : 259 t (l.4) ‘ 


li; : SI; : 262fl;0) ;?;;=> 


RACE/ETHNICITY 




I; 


!|j) 


White 


District of Columbia 


HpB ( 4.6) I n IS 




»***, !*;;• ' 




Northeast 




l| 272 (23) 1 


II •i.;i|273 : ( 3.4 




Nation 




1||P267 : ( 13)1?::=:;. 


Mi ia?!siplp)2) W :;: 


Black 


District of Columbia 


r' <196( 11) 


■ 228::t:;i;bj: it* 


SEgfaSi23o t?)4) Jill!; 




Northeast 


# -‘Vi99 ( ( < 2.9} ! . ii} 


i;:iip244 (i&ftiil:. 


:% 236 ( 4.1) • &, 




Nation 






151 ll# 23^57)W5ip: 


Hispanic 


District of Columbia 


•. ymt a.?) i , : L 


: ik: ; |212 : 133) =v 


111111822 


Northeast 






P !i!P^ii3f jrais 




Nation 




WKmmm 


g |§| 245 ( ,1.4) III 


TYPE OP COMMUNITY 






, 




Advantaged urban 


District of Columbia 


.ggiiKO.'i&l);-' A 


>\ 


|| Silli^liifaiS) Hill 


Northeast 




276 


111 yC 286 (:6. : 1)! . 




Nation 


Kiv;, : :238.(;3.1)l, ‘ 


‘.,278 (.47)1 v 


f V '280 ( 3.8)1 V ■ : 


Disadvantaged urban 


District of Columbia 






1% 221 ' ( 2.0) •/;' 


Northeast 




I8lBi241i.:(i10.9)i- ' 






Nation 




:':W':249 (<3.5;jV j 


f • i!;,';.,237 ( 2.7),' ift 


Other 


District of Columbia 




i:ts:;lp232T2.3 )•’ ’| 


ippli ||K : 25b:'( -2i3); Si| ;i : 




Northeast 


i\4 '&&&%}'*?} -h 


■ ■<27r(- 3.4) •, 


:ii'| ip1||-.:2b2'(.3i2) .'Ilf 




Nation 


'a;,;/ 


1 ;i||^ii|i.7) 


'jjll g 263,(':l‘.2).;|;>::,, 


PARENTS’ EDUCATION 






, • 23? 1.9) ,r \ 


... ‘ {> t ‘V:- .*0‘ ; t{> ‘ l!7'v‘ ,{ 


Graduated college 


District of Columbia 




; IB, 241 f i.9) 


Northeast 


:,“„230.(.3.0),, 


278 ,(.3.6)i,J 


v; *7‘‘« 276 ( 4.2) ' l 


Some education after high school 


Nation 


‘ 1225 Ll'.O)'", 


S31K27t(. 


‘ ‘ ‘ 272 ( 14)\ 


District of Columbia 




f : ?3f:232l : (:,2.7); Y i 




Northeast 


ffff228-('.5.3) " 3 


:¥,..\265jj‘‘3.7K . 


!|1! il|il!!2S2 ( 3.0) BY' 




Nation 


■|lS23 ! :(i2ffl) 


\L -262 '(- 1.9) ‘ ! 


33*il !|ftii!264 ( 1.4) [ *i ' 


Graduated high school 


District of Columbia 


a; 


1 p'224 (;'ii5)':, r l 


k- "‘‘,<‘222 ( 2.6) < Y c 


Northeast 




,',:'ii|259'(.'2.'8) •' 


11 Hill 257 ( 4?1) : lIIii 




Nation 


ilillis fl ; .8) V • 


ill 253 (SK5) • 


m BI254 ( T.4) ! ? 


Did not finish high school 


District of Columbia 


iff ;"::‘'i92 ( 4.2) 1 1| 


, 222 (2.7).* 


iitill Iliil224 ( 3.3) . ! 


Northeast 




t ' . , . 


p|fli243 ( 4.1) k.il;. 




Nation 


ill 208 ( 2l^Sl| 


IS 241 ( 2.1) ' 




1 don’t know 


District of Columbia 




g|li218'(;3.6). 


'! ' 227 ( 3.0) . 1 




Northeast 






111 ilillSSi 5 ( 2.6 yjy.^ 




Nation 




243 ( 3.3) _ 


p!jH j . 


GENDER 






:**** **' { *^lj* 


I: :?i ^ ‘ 


Mate 


District of Columbia 




1^227 (33) : 1 


I! - l‘T^29.( 1.6} I,' 




Northeast 


fW «’226 ( 2.1) ' 3 


269 ( 43)111 


■ i:llllil263 ( 3.0) 




Nation 


:< |H“‘!-:221 (06) 


260 (.1.7) :=1 

' ;';?23r { ( i.2)IK • 


SI 11=1262 ( 1‘.2) 


Female 


District of Columbia 


A ‘^99(‘1^)';m j 


111 |!I234: : ( 16) ' 1 




Northeast 


« / * ? 222 ( 3,1) H " 


i;r / |.;;267.(’3.3)k ' 


I! 1 j 262 ; ( 3.7) &i 




Nation 




Y ';/258 ( 14) : 


UPS 111262 : )( 1:2) IIP 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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Fourth- and Eighth-Grade Public-School 
Performance in Data Analysis, Statistics, 
and Probability by Subpopulation 



Trial State Assessment 



Grade 4 


Grade 8 


1892 


1990 


1992 



TOTAL 



RACE/ETHNICITY 

White 



Black 
Hispanic 

TYPE OF COMMUNITY 
Advantaged urban 

Disadvantaged urban 

Other 

PARENTS’ EDUCATION 
Graduated college 

Some education after high school 

Graduated high school 

Did not finish high school 

I don’t know 



GENDER 

Male 



Female 



District of Columbia 


!;!f c i 

mmm os^iii 


||||;Proflclency || 


Y|jF; ;: Proficiency 

v\ ipY'229Yll2) : :# 


Northeast 


!|:iiili29;it 2.3) ‘III! 


* 1273 .(.3.9) Y‘ t 


!g |;:Y; t 269 << ( 


Nation 


gpl&ie (f^pll! 




II 


District of Columbia 








Northeast 


232<(&$)/-‘Y& 




1| M?^2:t s!o) :|| 


Nation 




lil!!;l-272:!(|l .7) , 


:::=: fir 278 


District of Columbia 


& ; mtpsy < v 7 


l!;Bii|222i:(!^x)) : « , 


P; >•:• 


Northeast 


:\;v it&i £0) 


!ll!i|!^244"(;^.8)l 


c -.-..; 42 ae;< 4 . 2 ) ;* 7- 


Nation 




!lili^i ; (^) 1 


II 1 YY234:(^7r.-= : : 


District of Columbia 


=ii82 ( 3.3)’ £ iS5 


<208 ( 7.0). M 




Northeast 


■«;./, 201 ( 


'• ill;; 




Nation 


•:v--;:‘2oi ( msm 


23d|i , i) • V 


llliys 


District of Columbia 


3.0);il|l 




II r l|!^40<( Styi'H 


Northeast 




ii 


Nation . 




1 28$1(j 4-2)!<II 




District of Columbia 




.|i\Y21S‘ : ( 1.2)rll 


Y: fe=;ilfc22W^)<-,' 


Northeast 


®lM;296i ( 37)1 ^iiji 




Nation 


an 




li: ;i!:‘:;il236 ( 3 ^). ,t ‘ , ‘ ' 


District of Columbia 




: ‘F;l?227;|s( 3.8) =: : ? 


|l Wi 250 ( 3.5} H 


Northeast 


i ; aWalfii)! Ifl 




l;P 268! ( <314). ' ‘ ! <v 


Nation 


219 < i4i|i 




• j |i 288 M.4) 


District of Columbia 


( illlp: 




ft S= : 


Northeast 


;i“ IY‘230 ( 


I;lll28i7|( 4.0) lljp 




Nation 




{■•Y;'27e;H^)^7 


^;ifHi;28i ti&Ytv 


District of Columbia 






H Ki- 1-1238. ( 2J€N> 


Northeast 






1 ill! 270,( t{ 3.8) £i|; 


Nation 


< V ; < 225 ( 1.0} ( 


illI269i;(;'2lO)liliji 




District of Columbia 


^83'(/3.0) :i; li^ 


!ll!!l|2lM t(; 1:15)1111 


|Si;fl;:!2l8(!ilS) :1N= 


Northeast 


,215' (5.9) 1HI 


'■ 262 ( 3.2) •< ' : 




Nation 


2.o) ii® 


3l!IB;^l(-2l0);SiIl 




District of Columbia 


!iiiii [ 62^;3:4)iiiiiSi 




: -.i 220 < 3I8) VY 


Northeast 


... , ! j{ **+ 




' ;,!l-;l“' : ‘245' ( 545};;:P 


Nation 


' 204 ( i-lfllSll 


‘l<-238 ( 2.3) 


246 ( 2.5) ill 


District of Columbia 




. , • ‘%2H'4 2 A) * ■ ; 


;i 


Northeast 




’.iris* 


v i ! r‘249 ( 4A)S\ 


Nation 




,f \236 (:|ip)j|| 


|! fiSj 248 ( 2l2y-;|-;, 


District of Columbia 


«3>= 


V t; l?;224 ( 1.7) f$ 




Northeast 


:< :vV^4 ( 2.7) i 


j ! . ! ;j‘<: , :274::f:4.0) 


-ii li!|P2GBP(:35). <:fi- 


Nation 


: " ! - : 219 ( 111) : 


2.0) V Y 


jf w&tartm • 


District of Columbia 


•!.. . ‘.189,(1.4) . . 


i;l:;:iliil223 : (;-1 


W& 230: ('210):.:.Y 


Northeast 


HK7) r?k!«I 


273 ( 3.7) V 


^<209’i( ; { 4lO)' < |ii 


Nation 


iiliv;: '218 <( :1 5).:!; E 4‘i!::i:; 


•!:■ V - '- ;'262- ^ ^ .7)-, << f 


ill gg-- , 267 i$&pM 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14E 



Fourth- and Eighth-Grade Public-School 
Performance in Algebra and Functions by 
Subpopulation 



Grade 4 


Grade 8 
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1990 


1992 
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|||| ; ;Pr^Iencyft|J 


TOTAL 






Z iilMHijc ; j • tZ ;; 






District of Columbia 


. i 91 ( 0.7)4 r i" 


\ <23$ t M.1) <ft \ ( 






Northeast 


,222 •( 2,2)”. ;i 
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RACE/ETHNICITY 










White 


District of Columbia 


239< 4^) ‘ , 








Northeast 


S'f®232,<,2.6) V,;V 




III® (IP)If 




Nation 


iii£^224 






Black 


District of Columbia 


•STiSfe'-tlSDft : '>,v 


</ Vc s 285 






Northeast 


I«S?:194 ( 3.3) i ' 


!!:3i!ii247i;( 8.2)1 i> j *I 






Nation 


p;;P90' : ( i;7) ,1 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two Estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). Estimation was not included in the 1990 Trial State Assessment. ! Interpret with caution - the nature of the 
sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable 
estimate (fewer than 62 students). 
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In its landmark undertaking to set standards for mathematics curriculum and teaching, the National Council 
of Teachers of Mathematics (NCTM) made numerous recommendations for reforming how teachers teach 
the subject and how students learn it. 20 According to NCTM, to improve the nation’s mathematics 
proficiency, all students must learn more, and often different, mathematics, and instruction in mathematics 
must be significantly revised. 

The results of the Trial State Assessment can be used to monitor students’ progress in achieving the NCTM 
recommendations and to examine both school and home contexts for educational support. The 
public-school students participating in the 1992 Trial State Assessment, their mathematics teachers, and the 
principals or other administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. These student, teacher, and school data help to describe some of the current 
practices and emphases in mathematics education, illuminate some of the factors that appear to be related 
to fourth- and/or eighth-grade public-school students’ proficiency in the subject, and provide an educational 
context for understanding data on student achievement. The data from the questionnaires also provide a 
means to examine changes in policies, instruction, and programs at the eighth-grade level between 1990 and 
1992 for those states and territories that participated in both Trial State Assessment Programs. 

The questionnaire results provide a broad picture of educational practices prevalent in American schools 
and classrooms. It is important to note that the NAEP data cannot establish cause-and-effect links between 
various contextual factors and students’ mathematics proficiency. However, the results do provide 
information about important relationships between the contextual factors and proficiency. 



20 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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In many instances, NAEP findings reveal that educational researchers’ suggestions about what strategies 
work best to help students learn often go unheeded. For example, NCTM has recommended that teachers 
employ more hands-on activities and student -centered learning techniques. However, as described in 
Chapter 4, and similar to the findings from the 1990 NAEP mathematics assessment, NAEP data indicate 
that classroom work is still dominated by textbooks or worksheets. Also, it is widely recognized that home 
environment has an enormous impact on future academic achievement. Yet, as shown in Chapters 3 
and 7, and again similar to the findings from the 1990 NAEP mathematics assessment, large proportions 
of students still report spending much more time each day watching television than doing mathematics 
homework. 

The contextual information provided in Part Two of this report focuses on five major areas: instructional 
content, instructional practices and experiences, teacher characteristics, school characteristics and context, 
and conditions outside of school that affect instruction and learning. Part Two consists of five chapters. 
Chapter 3 discusses instructional content and its relationship to students’ mathematics proficiency. 

Chapter 4 focuses on instructional practices — how instruction is delivered. Chapter 5 is devoted to 
calculator and computer use, while Chapter 6 provides information about teachers and Chapter 7 examines 
students’ home support for learning. 
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CHAPTER 3 

What Are Students Taught in Mathematics? 



According to NCTM, curricular reform in grades kindergarten through 4 is necessary and must address both 
the content and emphasis of the curriculum as well as approaches to instruction. The need for reform is 
equally great in grades 5 through 8, where the current curriculum also does not match NCTM’s ideal. 21 
This chapter focuses on curricular and instructional content issues in District of Columbia public schools 
and their relationship to students’ proficiency. 



Table 15 provides a profile of the fourth- and eighth-grade public schools’ policies and practices in the 
District of Columbia. Some of the salient results obtained from the school and teacher questionnaires are: 



• According to the schools, almost all of the fourth-grade students and all of the eighth-grade 
students in the District of Columbia (95 percent and 100 percent, respectively) were in 
public schools where mathematics was identified as a special priority. This percentage for 
eighth grade increased from 1990 to 1992 (83 percent in 1990). 

• According to the schools in the District of Columbia, about three quarters of the 
eighth-grade students (74 percent) could take an algebra course in eighth grade for 

v high-school course placement or credit. This percentage of students decreased from 1990 
to 1992 (86 percent in 1990). 

• According to the schools in the District of Columbia, 93 percent of the eighth-grade 
students were taught mathematics by teachers who teach only one subject. The percentage 
of eighth-grade public-school students who were so taught mathematics decreased from 
1990 to 1992 (96 percent in 1990). 

• According to their teachers, about one quarter of the fourth-grade students and less than 
half of the eighth-grade students (22 percent and 42 percent, respectively) were typically 
taught mathematics in a class that was grouped by mathematics ability. For eighth-grade 
public-school students, this percentage decreased from 1990 to 1992 (51 percent in 1990). 

• According to their mathematics teachers, 75 percent of the fourth-grade students and 
52 percent of the eighth-grade students received four or more hours of mathematics 
instruction per week. 



21 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics' (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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TABLE 15 



Mathematics Policies and Practices in 
Dist. of Columbia Fourth-Grade and 
Eighth-Grade Public Schools 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. — Item does not apply to Grade 4, or comparisons to 1990 are not appropriate because of a change in the format 
of the question. In 1990, the students’ mathematics teachers were asked to specify the number of hours they spent providing 
mathematics instruction each week. In 1992, the form of the question was changed. Instead of asking the teachers to specify the 
number of hours, the teachers were asked to select from three options: that they spent (a) Two and one-half hours or less; 

(b) More than two and one-half hours but less than four hours; or (c) Four hours or more providing mathematics instruction per 
week. 
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CURRICULUM COVERAGE 



Course taking is related to mathematics proficiency because students who take more mathematics classes 
tend to learn more mathematics than those students who take fewer classes in this subject, or because 
students who are more proficient tend to take more mathematics courses and, in some cases, because the 
higher-achieving students are tracked into more advanced courses. 22 To place students’ mathematics 
proficiency in a curriculum-related context, it is necessary to examine the extent to which students in the 
District of Columbia are taking mathematics courses. Typically, all fourth-grade students take mathematics. 
All eighth graders, with very few exceptions, also take mathematics. However, the eighth graders take 
different types of mathematics courses, as shown in Table 16. 

• A smaller percentage of students in the District of Columbia were taking eighth-grade 
mathematics (42 percent) than were taking a course in pre-algebra or algebra (55 percent). 
Across the nation, however, about the same percentage of students were taking eighth-grade 
mathematics (50 percent) as were taking a course in pre-algebra or algebra (47 percent). 

• Students in the District of Columbia who were enrolled in eighth-grade mathematics courses 
exhibited lower average mathematics proficiency than did those who were in pre-algebra or 
algebra courses. 

• A greater percentage of students in the District of Columbia were taking algebra or 
pre-algebra in 1992 than in 1990. Across the nation as well, a greater percentage of students 
were taking algebra or pre-algebra in 1992 than in 1990. 

Further, from Table A 16 (Page 154) in the Data Appendix: 23 

• A greater percentage of eighth-grade females (60 percent) than males (49 percent) in the 
District of Columbia were enrolled in pre-algebra or algebra courses. 

• In the District of Columbia, 55 percent of Black students and 46 percent of Hispanic 
students were enrolled in pre-algebra or algebra courses. 

• In addition, 64 percent of students attending schools in advantaged urban areas, 56 percent 
of students in disadvantaged urban areas, and 54 percent of students in areas classified as 
“other” were enrolled in pre-algebra or algebra courses. 



22 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement : NAEP's 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 

23 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides a 
corresponding table presenting the results for the four subpopulations -- race/ethnicity, type of community, parents’ education 
level, and gender. Results for the region are contained in ; The 1992 State of Mathematics Achievement: NAEP's Assessment of 
the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 1993). 
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TABLE 16 



Eighth-Grade Students’ Reports on the 
Mathematics Class They Are Taking 



Grade 8 
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What kind of mathematics class are you taking this 
year? 

Eighth-grade Mathematics 

District of Columbia 

Northeast 

Nation 

Pre-algebra 

District of Columbia 

Northeast 

Nation 

Algebra 

District of Columbia 

Northeast 

Nation 





' 3 i Percentage 


and ( t . : . 'v‘<; V 


<V‘ > ! , ' [ and ; «‘ ] 


Proficiency ' i-j 


{ ;,/V (t ‘ Proficiency r 


$7 ( 1.0) 


SllSli’: {. 42 (-1.2) < 


liia^ 0,8) ’ r 




\‘‘ r e3 H 


ili &E ;l47 { (-3.o)^‘ 




( 3 . 9 ) * I; 






* 251 (-1,4) V; 


-V, 1 ‘253(1*5) .-{ 






( 242 < 2,3) ' a" , • 




Viiie ikfy -v? Y ,> 




‘‘ 278 <8.5)1 \ r « 


% :i.V :: v<i:272 (: ; 3.5) 


1.9) « 


2s5) > 


■271 (2.6) 


] | 271 


:?32 ( d 9)Hv 


: 35 ( 1.1) > 


>254 ( 4.5) •: 1- *7 


SSi^yilisi {"M, 


f 18 (S3\ «■ ' <f\ ' 


•• ' . 26 6,3.0) , ■; . 


4 


lilSiS:;.'. 296 (:;4A)' 


llpsni)’/ v ; < 




: 298f2‘A)|V' ,C!! ; 7 





The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. The percentages may not total 100 percent because a small number of 
students reported taking other or no mathematics classes. ! Interpret with caution ~ the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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MATHEMATICS HOMEWORK 



To examine the relationship between homework and proficiency in mathematics, the teachers of the 
assessed students were asked to report the amount of mathematics homework they assigned each day, and 
students were asked to report the amount of time they spent on mathematics homework each day. 

Table 17 reports the teachers’ and students’ responses. 



As reported by their mathematics teachers: 24 

• In the District of Columbia, 0 percent of the fourth-grade students and 0 percent of the 
eighth-grade students were not assigned any mathematics homework each day. 

• In addition, 5 percent of the fourth-grade students and 10 percent of the eighth-grade 
students in the District of Columbia were assigned an hour or more of mathematics 
homework each day. 

• The greatest percentage of fourth-grade students were assigned 30 minutes of mathematics 
homework each day, and the greatest percentage of eighth-grade students were assigned 30 
minutes of mathematics homework each day. 



According to the students: 



• In the District of Columbia, 3 percent of the fourth-grade students and 10 percent of the 
eighth-grade students did not spend any time each day on mathematics homework (either 
none was assigned or the students did not do the homework). 

• In addition, 19 percent of the fourth-grade students and 15 percent of the eighth-grade 
students in the District of Columbia spent an hour or more on mathematics homework. 

• In grade 8, average mathematics proficiency was higher for students in the District of 
Columbia who spent 30 minutes on mathematics homework than for students who spent 
no time on mathematics homework each day. 

• From 1990 to 1992, there was no significant difference in the percentage of eighth-grade 
students who did not spend any time each day on mathematics homework (7 percent in 
1990 and 10 percent in 1992). 

• From 1990 to 1992, there was no significant difference in the percentage of eighth-grade 
students who spent an hour or more each day on mathematics homework (16 percent in 
1990 and 15 percent in 1992). 



24 Comparisons between 1990 and 1992 are not possible for the teacher responses because of changes in the form of the questions 
that they were asked. 
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TABLE 17 



Teachers’ and Students’ Reports on the 
Amount of Time Students Spend on 
Mathematics Homework Each Day 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — Comparisons between 1990 and 1992 are not possible for the teacher 
responses because of changes in the form of the questions that they were asked. ! Interpret with caution - the nature of the sample 
does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate 
(fewer than 62 students). 
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INSTRUCTIONAL EMPHASIS 



According to NCTM, the teaching of computation and other traditional skills has dominated the 
mathematics curriculum at grades kindergarten through 4, while at grades 5 through 8, a repetition of topics, 
instructional approaches, and presentation have prevailed. In contrast, NCTM recommends that students 
be taught a broad range of mathematics topics, including number concepts, computation, estimation, 
functions, algebra, statistics, probability, geometry, and measurement. 25 

Because the Trial State Assessment questions were designed to measure students’ knowledge, skills, and 
understandings in various content areas — regardless of the type of mathematics class in which students were 
enrolled -- the teachers of the assessed students were asked a series of questions about the amount of 
emphasis they gave to each of five mathematics topics during the school year. Each topic corresponded to 
one of the five mathematics content areas included in the Trial State Assessment — Numbers and 
Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. The teachers’ responses provide an indication of students’ opportunity to learn those topics 
recommended by NCTM. 

The teachers were asked whether they were placing “heavy,” “moderate,” or “little or no” emphasis on each 
topic. Table 18 provides the results for this analysis and the average student proficiency in each content 
area. 

From Table 18: 



• In the District of Columbia, 84 percent of the fourth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 35 percent 
had teachers who placed heavy instructional emphasis on Measurement, 30 percent had 
teachers who placed heavy instructional emphasis on Geometry, 19 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
12 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 

• In the District of Columbia, 59 percent of the eighth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 18 percent 
had teachers who placed heavy instructional emphasis on Measurement, 24 percent had 
teachers who placed heavy instructional emphasis on Geometry, 29 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
54 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 

• Comparisons between 1990 an 1992 for two content areas — Numbers and Operations and 
Data Analysis, Statistics, and Probability — are not appropriate because of changes in the 
form of the questions that the students’ mathematics teachers were asked. Between 1990 
and 1992, the percentage of eighth-grade students whose teachers placed heavy instructional 
emphasis on Algebra and Functions increased. Between 1990 and 1992, there was a 
decrease in the percentage of eighth-grade students whose teachers placed heavy 
instructional emphasis on Measurement. 



25 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989 ). 
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Teachers’ Reports on the Emphasis Given 
to Specific Mathematics Content Areas 



1992 

Trial State Assessment 
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TABLE 18 I Teachers’ Reports on the Emphasis Given 
(continued) I to Specific Mathematics Content Areas 
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Teacher “emphasis” categories by content areas 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. The percentages may not total 100 percent because the “Moderate 
Emphasis” category is not included. — Comparisons between 1990 and 1992 for two content areas (Numbers and Operations and 
Data Analysis, Statistics, and Probability) are not appropriate because of changes in the form of the questions that the students’ 
mathematics teachers were asked. ! Interpret with caution - the nature of the sample does not allow accurate determination of the 
variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



SUMMARY 



The opportunity for all students to experience the components of mathematics training as outlined in the 
NCTM Standards is at the heart of NCTM’s recommendations for quality mathematics programs. 26 The 
information on curriculum coverage, mathematics homework, and instructional emphasis has revealed the 
following: 



• According to their mathematics teachers, 75 percent of the fourth-grade students and 
52 percent of the eighth-grade students received four or more hours of mathematics 
instruction per week. 

• According to their mathematics teachers, about three quarters of the eighth-grade students 
(74 percent) could take an algebra course in eighth grade for high-school course placement 
or credit. This percentage of students decreased from 1990 to 1992 (86 percent in 1990). 

• Students in the District of Columbia who were enrolled in eighth-grade mathematics courses 
exhibited lower average mathematics proficiency than did those who were in pre-algebra or 
algebra courses. 



26 Curriculum and Evaluation Standards for School Mathematics . (Reston, Va: National Council of Teachers of Mathematics, 
1989). 
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• According to their mathematics teachers, the greatest percentage of fourth-grade students 
were assigned 30 minutes of mathematics homework each day, and the greatest percentage 
of eighth-grade students were assigned 30 minutes of mathematics homework each day. 

• In grade 8, average mathematics proficiency was higher for students in the District of 
Columbia who spent 30 minutes on mathematics homework than for students who spent 
no time on mathematics homework each day. 

• In the District of Columbia, 84 percent of the fourth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 35 percent 
had teachers who placed heavy instructional emphasis on Measurement, 30 percent had 
teachers who placed heavy instructional emphasis on Geometry, 19 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
12 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 

• In the District of Columbia, 59 percent of the eighth-grade students had mathematics 
teachers who placed heavy instructional emphasis on Numbers and Operations, 18 percent 
had teachers who placed heavy instructional emphasis on Measurement, 24 percent had 
teachers who placed heavy instructional emphasis on Geometry, 29 percent had teachers 
who placed heavy instructional emphasis on Data Analysis, Statistics, and Probability, and 
54 percent had teachers who placed heavy instructional emphasis on Algebra and 
Functions. 
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CHAPTER 4 

How Is Mathematics Instruction Delivered? 

Mathematics instruction has been characterized by extensive use of textbooks and worksheets. 27 However, 
according to NCTM, what a student learns depends to a great degree on how he or she has learned it, and 
classroom instruction needs to be more student centered. 28 

To provide information about instructional delivery, public-school students and teachers participating in the 
Trial State Assessment were asked to report on the use of various teaching and learning activities in their 
mathematics classrooms. Students’ and teachers’ responses to a series of questions on their mathematics 
instruction provide an indication of the extent to which teachers are making use of student-centered 
activities. 



RESOURCES 



NCTM recommends well-equipped classrooms and instruction reflecting the vitality of mathematics. 29 
To examine the availability of resources, the assessed students’ teachers were asked about the extent to 
which they were able to obtain all of the resources they needed. 



From Table 19 and Table A19 (Page 174) in the Data Appendix: 

• In the District of Columbia, 2 percent of the fourth-grade students and 6 percent of the 
eighth-grade students had mathematics teachers who reported getting all of the resources 
they needed, while 77 percent of the fourth-grade students and 59 percent of the 
eighth- grade students were taught by teachers who got some or none of the resources they 
needed. 



27 Thomas A. Romberg and Thomas P. Carpenter. “Research on Teaching and Learning Mathematics: Two Disciplines of 
Scientific Inquiry,” in Handbook of Research on Teaching (Third Edition), M.C. Wittrock, Ed. (New York, NY: Macmillian, 
1980). 



28 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989). 

29 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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0 In grade 4, 3 percent of students attending "schools in advantaged urban areas, 4 percent 
of students in disadvantaged urban areas, and 0 percent of students in areas classified as 
“other” had mathematics teachers who got all the resources they needed. In grade 8, these 
percentages were 0 percent of students attending schools in advantaged urban areas, 
7 percent of students in disadvantaged urban areas, and 9 percent of students in areas 
classified as “other”. 

• By comparison, in grade 4, 57 percent of students in advantaged urban areas, 77 percent 
of students in disadvantaged urban areas, and 79 percent of students in areas classified as 
“other” had mathematics teachers who got some or none of the resources they needed. 
These figures for grade 8 were 100 percent of students in advantaged urban areas, 
54 percent of students in disadvantaged urban areas, and 37 percent of students in areas 
classified as “other”. 

0 Between 1990 and 1992, there was somewhat of an increase in the percentage of 
eighth-grade students whose teachers got all the resources they needed (4 percent in 1990 
and 6 percent in 1992). There was no significant difference in the percentage of students 
whose teachers got some or none of the resources they needed (58 percent in 1990 and 
59 percent in 1992). 
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TABLE 19 



Teachers’ Reports on the Availability of 
Resources 



Grade 4 


Grade 8 


1992 


1990 


1992 



Which of the following statements is true about how 
well supplied you are by your school system with 
the instructional materials and other resources you 
need to teach your class? 



I get all the resources I need. 

District of Columbia 

Northeast 

Nation 



/ get most of the resources I need. 
District of Columbia 



Northeast 

Nation 

/ get some or none of the resources I need. 
District of Columbia 

Northeast 

Nation 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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COLLABORATING IN SMALL GROUPS 



NCTM and others have recommended the use of small groups and cooperative-learning strategies for 
mathematics teaching in the middle grades. 30 Mathematics is suited for group discussion because students 
in groups can learn multiple strategies for solving the same problems and discuss the merits of different 
solutions to problems. Further, the positive affective impact of working together mirrors the use of 
mathematics in the workplace and reduces mathematics anxiety. 31 To examine the extent to which small 
groups are being used, students and their mathematics teachers were asked about the prevalence of these 
practices (Table 20). 

According to their mathematics teachers: 

• Many of the fourth-grade students in the District of Columbia (85 percent) and many of 
the eighth-grade students (80 percent) worked mathematics problems in small groups at 
least weekly; relatively few in grade 4 and relatively few in grade 8 never or hardly ever 
worked mathematics problems in small groups (4 percent and 5 percent, respectively). 

• About the same percentage of eighth-grade students in 1992 compared to 1990 worked 

mathematics problems in small groups at least weekly (80 percent in 1992 and 82 percent 
in 1990). > 

• A greater percentage of eighth-grade students in 1992 compared to 1990 never or hardly ever 
worked mathematics problems in small groups (5 percent in 1992 and 2 percent in 1990). 



According to students: 



• In the District of Columbia, 54 percent of the fourth-grade students and 53 percent of the 
eighth-grade students worked mathematics problems in small groups at least weekly; 

33 percent in grade 4 and 30 percent in grade 8 reported never or hardly ever working 
mathematics problems in small groups. 

• A greater percentage of eighth-grade students in 1992 compared to 1990 worked 
mathematics problems in small groups at least weekly (53 percent in 1992 and 47 percent 
in 1990). 

• A somewhat smaller percentage of eighth-grade students in 1992 compared to 1990 never 
or hardly ever worked mathematics problems in small groups (30 percent in 1992 and 

34 percent in 1990). 



30 David W. Johnson and Roger T. Johnson. “Using Cooperative Learning in Math,” in Cooperative Learning in Mathematics , Neil 
Davidson, Ed. (Menlo Park, CA: Addison-Wesley Publishing Company); Curriculum and Evaluation Standards for School 
Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1989); Professional Standards for Teaching 
Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991). 

31 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement: NAEP's 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 

92 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



District of Columbia 



THE NATION’S 
REPORT 
CARD 



1992 



imp 

Hi; 



Trial State Assessment 



TABLE 20 



Teachers’ and Students’ Reports on the 
Frequency of Small-Group Work 



Grade 4 


Grade 8 


1992 


1990 


1992 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



About how often do 
students work in small 
groups? 



At least weekly 

District of Columbia 



Northeast 

Nation 

Less than once a week 
District of Columbia 

Northeast 

Nation 



Never or hardly ever 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



USING MATHEMATICAL OBJECTS 

Regular use of concrete materials and tools can have a significant effect on both student achievement and 
attitudes toward mathematics. 32 To examine the use of mathematical objects, students and their 
mathematics teachers were asked to report on the frequency with which they used mathematical objects 
such as rulers, counting blocks, or geometric shapes (grade 4) or measuring instruments or geometric solids 
(grade 8). Table 21 summarizes these data. 



32 E.J. Sowell. “Effects of Manipulative Materials in Mathematics Instruction,” Journal for Research in Mathematics Education, 20 
(5). (November, 1989). pp. 498-505. 
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According to their mathematics teachers, relatively few of the fourth-grade students and less 
than half of the eighth-grade students in the District of Columbia (5 percent and 
34 percent, respectively) never or hardly ever used mathematical objects; 68 percent in 
fourth grade and 13 percent in eighth grade used these objects at least weekly. 

According to the students, about one quarter of the fourth-grade students and more than 
half of the eighth-grade students in the District of Columbia (30 percent and 58 percent, 
respectively) never or hardly ever used mathematical objects; 52 percent in fourth grade and 
21 percent in eighth grade used these objects at least weekly. 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). Comparisons to 1990 are not appropriate because of a change in the wording or format of the question. 
! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this statistic. 
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MATERIALS FOR MATHEMATICS INSTRUCTION 



Results from the 1990 NAEP mathematics assessment confirmed that high percentages of eighth-grade 
public-school students in the District of Columbia frequently worked mathematics problems from 
textbooks or worksheets. The results from the 1992 assessment indicate that these materials continue to 
play a major role in mathematics teaching and learning at both fourth grade and eighth grade. 



Regarding the frequency of textbook usage, according to the students’ mathematics teachers (Table 22 and 
Table A22A [Page 184] in the Data Appendix): 



• In the District of Columbia, 39 percent of the fourth-grade students and 7 1 percent of the 
eighth-grade students were assigned problems from a mathematics textbook almost every 
day; 7 percent and 5 percent in fourth and eighth grade, respectively, worked textbook 
problems less than weekly. 

• In grade 4, textbooks were used almost every day by 29 percent of students attending 
schools in advantaged urban areas, 42 percent of students in disadvantaged urban areas, and 
35 percent of students in areas classified as “other”. These figures for grade 8 were 
100 percent of students attending schools in advantaged urban areas, 58 percent of students 
in disadvantaged urban areas, and 86 percent of students in areas classified as “other”. 

• Comparing eighth-grade students’ mathematics teachers’ responses in 1990 with 1992, a 
greater percentage of students in 1992 (71 percent) than in 1990 (39 percent) used 
textbooks almost every day. 



According to the students themselves (Tables 22 and A22B [Page 186] in the Data Appendix): 



• In the District of Columbia, 41 percent of the fourth-grade students and 59 percent of the 
eighth-grade students were assigned problems from a mathematics textbook almost every 
day; 28 percent and 12 percent in fourth and eighth grade, respectively, worked textbook 
problems less than weekly. 

• In grade 4, textbooks were used almost every day by 47 percent of students attending 
schools in advantaged urban areas, 40 percent of students in disadvantaged urban areas, and 
44 percent of students in areas classified as “other”. For grade 8, these percentages were 
56 percent of students in advantaged urban areas, 52 percent of students in disadvantaged 
urban areas, and 65 percent of students in areas classified as “other”. 

• Comparing eighth-grade students’ responses in 1990 with 1992, a greater percentage of 
students in 1992 (59 percent) than in 1990 (53 percent) used textbooks almost every day. 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. I Interpret with caution -- the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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Next, examining the frequency of worksheet usage, according to the students’ mathematics teachers 
(Table 23 and Table A23A [Page 188] in the Data Appendix): 



•- About one quarter of the fourth-grade students and some of the eighth-grade students 
(24 percent and 13 percent, respectively) did problems from worksheets almost every day; 
some in grade 4 and less than half in grade 8 did worksheet problems less than weekly 
(17 percent and 31 percent, respectively). 

• In grade 4, worksheets were used almost every day by 24 percent of students attending 
schools in advantaged urban areas, 23 percent of students in disadvantaged urban areas, and 
28 percent of students in areas classified as “other”. For grade 8, these percentages were 
5 percent of students in advantaged urban areas, 23 percent of students in disadvantaged 
urban areas, and 3 percent of students in areas classified as “other”. 

• Comparing eighth-grade students’ mathematics teachers’ responses in 1990 with 1992, a 
greater percentage of students in 1992 (13 percent) than in 1990 (1 percent) used 
worksheets almost every day. 



And, according to the students (Table 23 and Table A23B [Page 190] in the Data Appendix): 

• About half of the fourth-grade students and less than half of the eighth-grade, students 
(52 percent and 38 percent, respectively) did problems from worksheets almost every day; 
some in grade 4 and some in grade 8 did worksheet problems less than weekly (16 percent 
and 20 percent, respectively). 

• In grade 4, worksheets were used almost every day by 47 percent of students in advantaged 
urban areas, 51 percent of students in disadvantaged urban areas, and 54 percent of 
students in areas classified as “other”. These figures for grade 8 were 40 percent of students 
in advantaged urban areas, 42 percent of students in disadvantaged urban areas, and 
32 percent of students in areas classified as “other”. 

• Comparing eighth-grade students’ responses in 1990 with 1992, a greater percentage of 
students in 1992 (38 percent) than in 1990 (29 percent) used worksheets almost every day. 
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About how often do 
students do problems on 
worksheets? 



Almost every day 
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At least once a week 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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SUMMARY 



An inspection of the availability and use of resources for mathematics education can provide insight into 
how and what students are learning in mathematics. It appears that mathematics textbooks and worksheets 
continue to play a major role in mathematics teaching. Although constant use of textbooks and worksheets 
does not preclude effective instruction, and NAEP data cannot establish the quality of instruction 
accompanying the use of materials, excessive reliance on textbooks and workbooks does indicate less 
attention to various student-centered strategies. 33 



According to the students’ mathematics teachers: 

• Many of the fourth-grade students in the District of Columbia (85 percent) and many of 
the eighth-grade students (80 percent) worked mathematics problems in small groups at 
least weekly; relatively few in grade 4 and relatively few in grade 8 never or hardly ever 
worked mathematics problems in small groups (4 percent and 5 percent, respectively). 

• In the District of Columbia, relatively few of the fourth-grade students and less than half 
of the eighth-grade students (5 percent and 34 percent, respectively) never or hardly ever 
used mathematical objects; 68 percent at grade 4 and 13 percent at grade 8 used these 
objects at least weekly. 

* 

• In the District of Columbia, 39 percent of the fourth-grade students and 71 percent of the 
eighth-grade students were assigned problems from a mathematics textbook almost every 
day; 7 percent and 5 percent in fourth and eighth grade, respectively, worked textbook 
problems less than weekly. 

• About one quarter of the fourth-grade students and some of the eighth-grade students 
(24 percent and 13 percent, respectively) did problems from worksheets almost every day; 
some in grade 4 and less than half in grade 8 did worksheet problems less than weekly 
(17 percent and 31 percent, respectively). 



And, according to the students: 



• In the District of Columbia, 54 percent of the fourth-grade students and 53 percent of the 
eighth-grade students worked mathematics problems in small groups at least weekly; 
33 percent in grade 4 and 30 percent in grade 8 reported never or hardly ever working 
mathematics problems in small groups. 

• In the District of Columbia, about one quarter of the fourth-grade students and more than 
half of the eighth-grade students (30 percent and 58 percent, respectively) never or hardly 
ever used mathematical objects; 52 percent at grade 4 and 21 percent at grade 8 used these 
objects at least weekly. 



33 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement: NAEP’s 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 
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• In the District of Columbia, 41 percent of the fourth-grade students and 59 percent of the 
eighth-grade students were assigned problems from a mathematics textbook almost every 
day; 28 percent and 12 percent in fourth and eighth grade, respectively, worked textbook 
problems less than weekly. 

• About half of the fourth-grade students and less than half of the eighth-grade students 
(52 percent and 38 percent, respectively) did problems from worksheets almost every day; 
some in grade 4 and some in grade 8 did worksheet problems less than weekly (16 percent 
and 20 percent, respectively). 
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CHAPTER 5 

How Are Calculators and Computers Used? 

Recommendations for improving mathematics education often include more use of calculators and 
computers. 34 The NCTM initiatives describe the benefits provided by calculators and computers to replace 
hand calculations and suggest that these instruments provide a basis for more complex problem-solving 
situations that engage students in mathematics learning. 

Consistent with the importance of using technology in mathematics instruction, NAEP provided 
four-function calculators to fourth graders and scientific calculators to eighth graders for portions of the 
Trial State Assessment and conducted brief training exercises in their use prior to the assessment. 
Information was collected about students’ understanding of when to use a calculator as well as measuring 
whether they knew how to use a calculator. Additionally, students, teachers, and administrators were asked 
whether calculators and computers were available in school and how frequently they were used. 



ACCESS TO AND USE OF CALCULATORS 



Table 24 provides a profile of District of Columbia fourth- and eighth-grade public schools’ policies with 
regard to calculator use: 



• In relation to 5 percent of fourth graders and 49 percent of eighth graders across the nation, 
32 percent of the fourth-grade students and 60 percent of the eighth-grade students in the 
District of Columbia had teachers who allowed calculators to be used for tests. Comparing 
eighth-grade responses in 1990 and 1992, the percentage of eighth-grade students in the 
District of Columbia who had teachers who allowed calculators to be used for tests 
increased from 1990 to 1992 (49 percent in 1990 and 60 percent in 1992). 



34 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991); 
Everybody Counts: A Report to the Nation on the Future of Mathematics Education , Lynn Steen, Ed. (Washington, DC: National 
Research Council, National Academy Press, 1989). 
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• In fourth grade, a greater percentage of students in the District of Columbia (25 percent) 
than in the nation (5 percent) had teachers who permitted unrestricted use of calculators. 
Similarly, in eighth grade, a greater percentage of students in the District of Columbia 
(45 percent) than in the nation (30 percent) had teachers who permitted unrestricted use 
of calculators. In 1990, the percentage of eighth-grade students who had teachers who 
allowed unrestricted use of calculators was 38 percent in the District of Columbia and 
18 percent in the nation. 

• Many of fourth graders in the District of Columbia (89 percent) and more than half in the 
nation (62 percent) were in schools in which they were given access to calculators owned 
by the school. In addition, 89 percent of fourth graders in the District of Columbia and 
66 percent in the nation had mathematics teachers who reported providing instruction to 
students in the use of calculators. 

• In the District of Columbia, 71 percent of eighth-grade students were in schools in which 
they were given access to four-function calculators and 84 percent were in schools in which 
they were given access to scientific calculators. Across the nation, these figures were 
66 percent for four-function calculators and 37 percent for scientific calculators. In 
addition, in the District of Columbia, 62 percent of eighth graders had mathematics teachers 
who reported providing instruction to students in the use of four-function calculators and 
74 percent had teachers who reported providing instruction about scientific calculators. 
Nationally, these figures were 64 percent and 37 percent of the eighth-grade students, 
respectively. 
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TABLE 24 



Teachers’ Reports on Policies about 
Calculator Use 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. — Item not asked at this grade level in this year. 
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Both students and their mathematics teachers were also asked about the frequency of the use of calculators 
in mathematics class. From Table 25: 



• According to the students’ mathematics teachers, 59 percent of the: fourth-grade students 
and 61 percent of the eighth-grade students used calculators at least weekly in mathematics 
class. By comparison, 13 percent and 12 percent in fourth and eighth grade, respectively, 
never or hardly ever used a calculator. In 1990, 57 percent of the eighth-grade students had 
mathematics teachers who reported that they used calculators at least weekly and 9 percent 
had mathematics teachers who reported that they never or hardly ever used calculators. 

• According to the students, 61 percent of the fourth graders and 56 percent of the eighth 
graders used calculators at least weekly in mathematics class. By comparison, 25 percent 
and 25 percent in fourth and eighth grade, respectively, never or hardly ever used a 
calculator. In 1990, 55 percent of the eighth-grade students used calculators at least weekly 
and 27 percent never or hardly ever used calculators. 
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The N AEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution ~ the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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THE AVAILABILITY OF COMPUTERS 



Computers can be used in a wide variety of ways in mathematics classrooms. Although they may be most 
frequently used for computational drill and practice, teachers can take full advantage of this technology by 
using computers to teach graphs, spreadsheets, and extended investigations of mathematical ideas. 35 The 
computer has the potential to provide opportunities for problem solving using “hands-on” techniques and 
also can be effective as a tool in small-group work. 

NAEP asked students and teachers in public schools about the availability and use of computers in 
mathematics instruction. As shown in Table 26: 



• About one quarter of the fourth-grade students (27 percent) and some of the eighth-grade 
students (20 percent) had teachers who reported that computers were available in the 
classroom. The percentage of eighth-grade students in the District of Columbia who had 
teachers who reported that computers were available in the classroom stayed about the same 
from 1990 to 1992 (18 percent in 1990 and 20 percent in 1992). 

• In the District of Columbia, 28 percent of the fourth-grade students and 40 percent of the 
eighth-grade students had teachers who reported that the primary use of these computers 
was drill and practice. In addition, 7 percent of the fourth-grade students and 19 percent 
of the eighth-grade students had teachers who reported that the primary use was learning 
new topics in mathematics. 



And, from Table 27: 

• According to the students’ mathematics teachers, 42 percent of the fourth-grade students 
and 1 5 percent of the eighth-grade students used computers at least weekly in mathematics 
class. By comparison, 35 percent and 59 percent in fourth and eighth grade, respectively, 
never or hardly ever used a computer. In 1990, 22 percent of the eighth-grade students had 
mathematics teachers who reported that they used computers at least weekly and 42 percent 
had mathematics teachers who reported that they never or hardly ever used computers. 

• According to the students, 29 percent of the fourth graders and 21 percent of the eighth 
graders used computers at least weekly in mathematics class. By comparison, 62 percent 
and 66 percent in fourth and eighth grade, respectively, never or hardly ever used a 
computer. In 1990, 20 percent of the eighth-grade students used computers at least weekly 
and 66 percent never or hardly ever used computers. 



35 Mary Male. “Cooperative Learning and Computers in the Elementary and Middle School Math Classroom,” in Cooperative 
Learning in Mathematics, Neil Davidson, Ed. (Menlo Park, CA: Addison-Wesley Publishing Company, 1990); Charlene Sheets 
and M. Kathleen Heid. “Integrating Computers as Tools in Mathematics Curricula (Grades 9-13): Portraits of Group 
Interactions,” in Cooperative Learning in Mathematics , Neil Davidson, Ed. (Menlo Park, CA: Addison-Wesley Publishing 
Company, 1990). 
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Teachers’ Reports on the Availability and 
Primary Use of Computers in Mathematics 
Classrooms 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. — Item not asked at this grade level in this year. 



106 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



District of Columbia 



THE NATION’S 
REPORT 
CARD 

1992 

Trial State Assessment 



TABLE 27 






Teachers’ and Students’ Reports on the 
Frequency of Computer Use in 
Mathematics Classrooms 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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WHEN TO USE A CALCULATOR 

Part of the Trial State Assessment was designed to investigate whether students know when the use of a 
calculator is helpful and when it is not. In 1992, there were 13 sections of mathematics questions in the 
assessment at each grade level. For three of the 13 sections at grades 4 and 8, students were given calculators 
to use. The test administrator provided the students with instructions and practice on how to use the 
calculator prior to the assessment. During the assessment, students were allowed to choose whether or not 
to use the calculator for each item in the calculator sections, and they were asked to indicate in their test 
booklets whether they did or did not use it for each item. Because of the sampling methodology used for 
the Trial State Assessment, not every student took all of the calculator sections. Some took two calculator 
sections, some took one section, and some took none, Certain items in the calculator sections were defined 
as “calculator-suitable” items — that is, items for which the calculator was useful but not required to 
determine the correct response. The remainder of the items were “calculator-unsuitable” items - items for 
which the use of the calculator was inappropriate. In total, at fourth grade there were 26 calculator-suitable 
items and 1 1 calculator-unsuitable items across the three sections; at eighth grade, there were 23 
calculator-suitable items and 12 calculator-unsuitable items across the three sections. 

To examine the characteristics of students who generally knew when the use of the calculator was helpful 
and those who did not, the students who responded to one or two of the calculator sections were categorized 
into two groups: 

• High - students who used the calculator for at least 65 percent of the calculator-suitable 
items and used the calculator for no more than one of the calculator-unsuitable items. 

• Other — students who used the calculator for less than 65 percent of the calculator- suitable 
items or used it for more than one of the calculator-unsuitable items. 

Thus, students in the “High” group used the calculator frequently and appropriately. Students in the 
“Other” group used the calculator less frequently or inappropriately. The data presented in Table 28 and 
Table A28 (Page 200) in the Data Appendix indicate that: 

• A smaller percentage of fourth-grade students in the District of Columbia were in the High 
group (26 percent) than were in the Other group (74 percent); a smaller percentage of 
eighth-grade students in the District of Columbia were in the High group (20 percent) than 
were in the Other group (80 percent). 

• At fourth grade, a greater percentage of females than males were in the High group 
(28 percent of females and 22 percent of males). At eighth grade, a greater percentage of 
females than males were in the High group (24 percent of females and 15 percent of males). 

• At fourth grade, 15 percent of White students, 26 percent of Black students, and 23 percent 
of Hispanic students were in the High group. 

• At eighth grade, 19 percent of Black students and 16 percent of Hispanic students were in 
the High group. 
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table 28 | Students 9 Knowledge of Using Calculators 



1992 Grade 4 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). Comparisons to 1990 are not appropriate because of the changing nature of the calculator-suitable and 
calculator-unsuitable items and the changing nature of the definitions of the “High” and “Other" groups from 1990 to 1992. 
Students in the “High” group used the calculator for at least 65 percent of the calculator-suitable items and used the calculator for 
no more than one of the calculator-unsuitable items. Students in the “Other" group used the calculator for less than 65 percent of 
the calculator-suitable items or used it for more than one of the calculator-unsuitable items. 



SUMMARY 



NCTM recommends that: 36 

• Appropriate calculators (i.e., scientific calculators for middle school and scientific/graphing 
calculators for high school) should be available to all students at all times. 

• A computer should be available in every classroom for demonstration purposes. 

• Every student should have access to a computer for individual and group work. 

• Students should learn to use the computer as a tool for processing information and 
performing calculations to investigate and solve problems. 



36 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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The data related to calculators and computers and their use show that: 



• In fourth grade, a greater percentage of students in the District of Columbia (25 percent) 
than in the nation (5 percent) had teachers who permitted unrestricted use of calculators. 
Similarly, in eighth grade, a greater percentage of students in the District of Columbia 
(45 percent) than in the nation (30 percent) had teachers who permitted unrestricted use 
of calculators. 

• In the District of Columbia, 71 percent of eighth-grade students were in schools in which 
they were given access to four-function calculators and 84 percent were in schools in which 
they were given access to scientific calculators. Across the nation, these figures were 
66 percent for four-function calculators and 37 percent for scientific calculators. In 
addition, in the District of Columbia, 62 percent of eighth graders had mathematics teachers 
who reported providing instruction to students in the use of four-function calculators and 
74 percent had teachers who reported providing instruction about scientific calculators. 
Nationally, these figures were 64 percent and 37 percent of the eighth-grade students, 
respectively. 

• According to the students’ mathematics teachers, 59 percent of the fourth-grade students 
and 61 percent of the eighth-grade students used calculators at least weekly in mathematics 
class. By comparison, 13 percent and 12 percent in fourth and eighth grade, respectively, 
never or hardly ever used a calculator. In 1990, 57 percent of the eighth-grade students had 
mathematics teachers who reported that they used calculators at least weekly and 9 percent 
had mathematics teachers who reported that they never or hardly ever used calculators. 

• According to the students, 61 percent of the fourth graders and 56 percent of the eighth 
graders used calculators at least weekly in mathematics class. By comparison, 25 percent 
and 25 percent in fourth and eighth grade, respectively, never or hardly ever used a 
calculator. In 1990, 55 percent of the eighth-grade students used calculators at least weekly 
and 27 percent never or hardly ever used calculators. 

• About one quarter of the fourth-grade students (27 percent) and some of the eighth-grade 
students (20 percent) had teachers who reported that computers were available in the 
classroom. The percentage of eighth-grade students in the District of Columbia who had 
teachers who reported that computers were available in the classroom stayed about the same 
from 1990 to 1992 (18 percent in 1990 and 20 percent in 1992). 

• In the District of Columbia, 28 percent of the fourth-grade students and 40 percent of the 
eighth-grade students had teachers who reported that the primary use of these computers 
was drill and practice. By comparison, 7 percent of the fourth-grade students and 
19 percent of the eighth-grade students had teachers who reported that the primary use was 
learning new topics in mathematics. 
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CHAPTER 6 

Who Is Teaching Fourth-Grade and Eighth-Grade 
Mathematics? 



Teachers have a vital function in improving students’ mathematics learning. Thus, it is of interest to 
examine the educational background, experience, and certification of the teachers who are teaching fourth- 
and eighth-grade mathematics in public schools. As shown in Table 29: 

• In the District of Columbia, 48 percent of the fourth-grade students and 58 percent of the 
eighth-grade students were being taught by mathematics teachers who reported having at 
least a master’s or education specialist’s degree. Across the nation, these figures were 
47 percent and 47 percent for fourth- and eighth-grade students, respectively. 

• About three quarters of the students in fourth grade (72 percent) and about three quarters 
in eighth grade (79 percent) had mathematics teachers who had the highest level of teaching 
certification available. Across the nation, 57 percent of the fourth-graders and 63 percent 
of the eighth-graders were taught by mathematics teachers who were certified at the highest 
level available in their states. 

• Relatively few of the fourth-grade students (2 percent) and almost all of the eighth-grade 
students (92 percent) in the District of Columbia had mathematics teachers who had a 
mathematics (middle/junior high or secondary school) teaching certificate. Across the 
nation, 10 percent in grade 4 and 79 percent in grade 8 had teachers with such 
certification. 

• In 1990, 60 percent of the eighth-grade students were being taught by mathematics teachers 
who reported having at least a master’s or education specialist’s degree, 71 percent were 
taught by teachers who had the highest level of teacher certification available in the District 
of Columbia, and 92 percent by teachers who had a mathematics (middle/junior high or 
secondary school) teaching certificate. As indicated above, in 1992, the comparable figures 
were 58 percent, 79 percent, and 92 percent, respectively. 
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TABLE 29 



Profile of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Teachers 



Trial State Assessment 



Grade 4 


Grade 8 


1992 


1990 


1992 ' 



Percentage of students whose mathematics teachers 
reported having the following degrees 

Bachelor’s degree 

District of Columbia 

Northeast 

Nation 

Master’s or specialist’s degree 
District of Columbia 
Northeast 
Nation 

Doctorate or professional degree 
District of Columbia 
Northeast 
Nation 



Percentage of students whose mathematics teachers 
reported having the following types of teaching 
certificates that are recognized by the District of 
Columbia 



No regular certification 

District of Columbia 

Northeast 

Nation 

Regular certification but less than the highest available 
District of Columbia 
Northeast 
Nation 

Highest certification available (permanent or long-term) 
District of Columbia 
Northeast 
Nation 



Percentage of students whose mathematics teachers 
reported having teaching certification in the 
following areas that are recognized by the District 
of Columbia 



Mathematics (middle school or secondary) 
District of Columbia 
Northeast 
Nation 

Education (elementary or middle school) 
District of Columbia 
Northeast 
Nation 



Other 
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Northeast 

Nation 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 
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EDUCATIONAL BACKGROUND 



Although mathematics teachers are held responsible for providing high-quality instruction to their students, 
there continues to be concern that many have had limited exposure to some content and concepts in the 
subject area. The Trial State Assessment gathered details on the teachers’ educational backgrounds — more 
specifically, their undergraduate and graduate majors and their in-service training. Tables 30 and 31 provide 
information about the educational background of the students’ mathematics teachers. 

Summarizing teacher responses to questions concerning their undergraduate and graduate fields of study 
(Table 30): 37 

• In the District of Columbia, 4 percent of the fourth-grade and 63 percent of the 
eighth-grade public-school students were being taught mathematics by teachers who had an 
undergraduate major in mathematics. Across the nation, 5 percent of the fourth-grade 
students and 45 percent of the eighth-grade students had mathematics teachers with a major 
in mathematics. 

• Relatively few of the fourth-grade and about one quarter of the eighth-grade students in the 
District of Columbia (9 percent and 26 percent, respectively) were taught mathematics by 
teachers who had a graduate major in mathematics. Across the nation, 2 percent and 
21 percent of the fourth- and eighth-grade students, respectively, were taught by teachers 
who majored in mathematics in graduate school. 



Summarizing teacher responses to questions concerning their in-service training for the year preceding the 
Trial State Assessment (Table 31): 

• In the District of Columbia, 22 percent of the fourth-grade and 48 percent of the 
eighth-grade public-school students had teachers who spent at least 16 hours on in-service 
education dedicated to mathematics or the teaching of mathematics. Across the nation, 

21 percent of the fourth-grade students and 47 percent of the eighth-grade students had 
teachers who spent at least that much time on similar types of in-service training. 

• Relatively few of the fourth-grade students and relatively few of the eighth-grade students 
in the District of Columbia (8 percent and 3 percent, respectively) had mathematics 
teachers who did not spend any time on in-service education devoted to mathematics or the 
teaching of mathematics. Nationally, 17 percent of the fourth-grade students and 8 percent 
of the eighth -grade students had mathematics teachers who did not spend any time on 
similar in-service training. 

• The percentage of eighth-grade students in 1992 with teachers who reported spending at 
least 16 hours on in-service education dedicated to mathematics or the teaching of 
mathematics decreased somewhat compared to 1990 (48 percent in 1992 and 53 percent in 
1990). 

• The percentage of eighth-grade students in 1992 with teachers who reported spending no 
time on in-service education dedicated to mathematics or the teaching of mathematics 
decreased compared to 1990 (3 percent in 1992 and 5 percent in 1990). 



37 Comparisons of teachers’ responses in 1990 and 1992 about their undergraduate and graduate degrees are not possible because 
of changes in the form of the questions that the teachers were asked. 



2 NAEP TRIAL STATE ASSESSMENT 



113 



107 



District of Columbia 



e~ 



THE NATION’S 
REPORT 
CARD 



1992 



rasp 

i£' 



Trial State Assessment 



TABLE 30 



Teachers’ Reports on Their Undergraduate 
and Graduate Fields of Study 



1992 Grade 4 



1992 Grade 8 



What was your undergraduate major? 



Mathematics 

District of Columbia 

Northeast 

Nation 

Mathematics Education 

District of Columbia 

Northeast 

Nation 

Education 

District of Columbia 

Northeast 

Nation 

Other 

District of Columbia 

Northeast 

Nation 



What was your graduate major? 



Mathematics 

District of Columbia 

Northeast 

Nation 

Mathematics Education 
District of Columbia 
Northeast 
Nation 

Education 

District of Columbia 

Northeast 

Nation 

Other or no graduate level of study 
District of Columbia 
Northeast 
Nation 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest,- the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). Comparisons of teachers’ 
responses in 1990 and 1992 about their undergraduate and graduate degrees are not possible because of changes in the form of the 
questions that the teachers were asked. 
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TABLE 31 



Teachers’ Reports on Their In-Service 
Training 



Grade 4 


Grade 8 


1992 


1990 


1992 





During the last year, how much time in total have 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 



SUMMARY 



Results from the 1990 NAEP mathematics assessment have indicated that students’ achievement in 
mathematics is much lower than educators and the public would like it to be. 38 In curriculum areas 
requiring special attention and improvement, such as mathematics, it is particularly important to have 
well-qualified teachers. There is no guarantee that individuals with a specific set of credentials will be 
effective teachers; however, it is likely that relevant training and experience do contribute to better teaching. 

The information about public-school teachers’ educational backgrounds and experience reveals that: 



• In the District of Columbia, 48 percent of the fourth-grade students and 58 percent of the 
eighth-grade students were being taught by mathematics teachers who reported having at 
least a master’s or education specialist’s degree. Across the nation, these figures were 
47 percent and 47 percent for fourth- and eighth-grade students, respectively. 

• In the District of Columbia, 4 percent of the fourth-grade and 63 percent of the 
eighth-grade students were being taught mathematics by teachers who had an undergraduate 
major in mathematics. Across the nation, 5 percent of the fourth-grade students and 
45 percent of the eighth-grade students had mathematics teachers with a major in 
mathematics. 



38 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement: NAEP's 1990 
Assessment of the Nation and the Trial Assessment of the States . (Washington, DC: National Center for Education Statistics, 
1991). 
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• Relatively few of the fourth-grade and about one quarter of the eighth-grade students in the 
District of Columbia (9 percent and 26 percent, respectively) were taught mathematics by 
teachers who had a graduate major in mathematics. Across the nation, 2 percent and 
21 percent of the fourth- and eighth-grade students, respectively, were taught by teachers 
who majored in mathematics in graduate school. 

• In the District of Columbia, 22 percent of the fourth-grade and 48 percent of the 
eighth-grade students had teachers who spent at least 16 hours on in-service education 
dedicated to mathematics or the teaching of mathematics. Across the nation, 21 percent 
of the fourth-grade students and 47 percent of the eighth-grade students had teachers who 
spent at least that much time on similar types of in-service training. 

• Relatively few of the fourth-grade students and relatively few of the eighth-grade students 
in the District of Columbia (8 percent and 3 percent, respectively) had mathematics 
teachers who did not spend any time on in-service education devoted to mathematics or the 
teaching of mathematics. Nationally, 17 percent of the fourth-grade students and 8 percent 
of the eighth-grade students had mathematics teachers who did not spend any time on 
similar in-service training. 
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CHAPTER 7 

The Conditions Beyond School that Facilitate Mathematics 
Learning and Teaching 

Parents are children’s first teachers and should remain instrumental in their children’s educational 
success. 39 Parents can support learning in many ways, including monitoring homework, turning off the 
television in favor of reading or other literacy-related activities, and making sure that students are attending 
school. To examine the relationship between home environment and mathematics proficiency, students 
participating in the Trial State Assessment were asked a series of questions about themselves, their parents 
or guardians, and home factors related to education. 



AMOUNT OF READING MATERIALS IN THE HOME 



The number and types of reading and reference materials in the home may be an indicator of the value 
placed by parents on learning and schooling. Public-school students participating in the Trial State 
Assessment were asked about the availability of newspapers, magazines, books, and an encyclopedia at 
home. Average mathematics proficiency associated with having zero to two, three, or four of these types 
of materials in the home is shown in Table 32 and Table A32 (Page 202) in the Data Appendix. 

The data for the District of Columbia reveal that: 



• Grade 4 students in the District of Columbia who had all four of these types of materials 
in the home showed a higher mathematics proficiency than did students with zero to two 
types of materials. This is similar to the results for the grade 8 students in the District of 
Columbia, where students who had all four types of materials showed a higher mathematics 
proficiency than did students who had zero to two types. 



39 Carnegie Council on Adolescent Development. Turning Points: Preparing American Youth for the 21st Century. (New York, 
NY: Carnegie Corporation of New York, 1989); James P. Comer. “Home, School, and Academic Learning,” in Access to 
Knowledge: An Agenda for Our Our Nation's Schools, John T. Goodlad and Pamela Keating, Eds. (New York, NY: College 
Entrance Examination Board, 1990); The Harvard Education Letter. “Parents and Schools.” (Cambridge, MA: Harvard 
University Press, November /December 1988). 
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• In grade 4, 54 percent of White students, 28 percent of Black students, and 16 percent of 
Hispanic students had all four types of these reading materials in their homes. 

• In grade 8, 38 percent of Black students and 30 percent of Hispanic students had all four 
types of these reading materials in their homes. 

• Compared to 1990, about the same percentage of eighth-grade students in 1992 had all four 
types of these reading materials in their homes (42 percent in 1990 and 38 percent in 1992). 
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TABLE 32 



Students’ Reports on Types of Reading 
Materials in the Home 



Grade 4 


Grade 8 


1992 


1990 


1992 



Does your family have, or receive on a regular 
basis, each of the following items: more than 25 
books, an encyclopedia, newspapers, magazines? 



Zero to two types 

District of Columbia 

Northeast 

Nation 



Three type s 

District of Columbia 

Northeast 

Nation 



Four types 
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Nation 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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HOURS OF TELEVISION WATCHED PER DAY 



Report after report has chronicled the relationship between television watching and achievement. 40 To 
provide additional relevant data, public-school students participating in the 1992 Trial State Assessment 
were asked to report on the amount of television they watched each day (Table 33 and Table A33 [Page 
204] in the Data Appendix). 



In grade 4: 

• Average mathematics proficiency was lowest for students in the District of Columbia who 
spent six hours or more watching television each day. 

• Some of the students in the District of Columbia (16 percent) watched one hour or less of 
television each day; 37 percent watched six hours or more. 

• In the District of Columbia, 9 percent of White students, 40 percent of Black students, and 
32 percent of Hispanic students watched six hours or more of television each day. 

• By comparison, 35 percent of White students, 15 percent of Black students, and 20 percent 
of Hispanic students watched an hour or less of television each day. 

In grade 8: 

• In the District of Columbia, average mathematics proficiency was higher for students who 
spent two hours watching television than for students who watched television six hours or 
more each day. 

• Relatively few of the students in the District of Columbia (7 percent) watched one hour 
or less of television each day; 31 percent watched six hours or more. In 1990, 8 percent 
watched one hour or less of television each day while 33 percent watched six hours or more. 

• In the District of Columbia, 34 percent of Black students and 20 percent of Hispanic 
students watched six hours or more of television each day. 

r 

• In addition, 6 percent of Black students and 8 percent of Hispanic students watched an 
hour or less of television each day. 

• Compared to 1990, about the same percentage of eighth-grade students in 1992 watched six 
hours or more of television each day (33 percent in 1990 and 31 percent in 1992). About 
the same percentage of eighth-grade students in 1992 watched an hour or less of television 
each day (8 percent in 1990 and 7 percent in 1992). 



40 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The Slate of Mathematics Achievement: NAEP’s 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 
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Students’ Reports on the Amount of Time 
Spent Watching Television Each Day 



Trial State Assessment 



Grade 4 


Grade 8 


1992 


1990 


1992 




One hour or less 

District of Columbia 

Northeast 

Nation 

Two hours 

District of Columbia 

Northeast 

Nation 

Three hours 
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Northeast 

Nation 
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Nation 
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The N AEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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STUDENT ABSENTEEISM 



Excessive absenteeism may also be an obstacle to students’ success in school. To examine the relationship 
of student absenteeism to mathematics proficiency, the eighth-grade students participating in the Trial State 
Assessment were asked to report on the number of days of school they missed during the one-month period 
preceding the assessment. 



From Table 34: 



• Average mathematics proficiency was lowest for eighth-grade students who missed three or 
more days of school. 

• Less than half of the students in grade 8 (34 percent) did not miss any school days in the 
month prior to the assessment, while 34 percent in grade 8 missed three days or more. 

• In 1990, 33 percent of the eighth-grade students did not miss any school days in the month 
prior to the assessment, while 37 percent missed three days or more. 
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TABLE 34 



Eighth-Grade Students’ Reports on the 
Number of Days of School Missed 



1990 



Grade 8 



1992 




The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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STUDENTS’ PERCEPTIONS OF MATHEMATICS 



Learning mathematics should require students not only to master essential skills and concepts, but also to 
develop confidence in their mathematical abilities and to value mathematics as a discipline. 41 Students 
were asked if they agreed or disagreed with a series of statements designed to elicit their perceptions of 
mathematics. These included statements about: 

• Personal experience with mathematics, including students* enjoyment of mathematics and 

level of confidence in their mathematical abilities: I like mathematics ; l am good in 

mathematics. 

• Value of mathematics, including students* perceptions of its present utility and its expected 
relevance to future work and life requirements: Almost all people use mathematics in their 
jobs; Mathematics is not more for boys than for girls . 

• The nature of mathematics, including students’ ability to identify the salient features of the 
discipline: Mathematics is useful for solving everyday problems. 



A “perception index** was developed to examine students’ perceptions of mathematics. For each of the five 
attitude statements, students who responded “strongly agree** were given a value of 1 (indicating very 
positive attitudes about the subject), students who responded “agree” were given a value of 2, and students 
who responded “undecided,” “disagree,** or “strongly disagree” were given a value of 3. 42 Each student’s 
responses were averaged over the five statements. The students were then assigned a perception index 
according to whether they tended to strongly agree with the statements (an index of 1); tended to agree with 
the statements (an index of 2); or tended to be undecided, to disagree, or to strongly disagree (eighth grade 
only) with the statements (an index of 3). 

Table 35 provides the data for public- school students’ attitudes toward mathematics as defined by their 
perception index. The following results were observed for the District of Columbia. 

In grade 4: 

• Average mathematics proficiency was higher for students who were in the “agree” category 
than for students who were in the “undecided, disagree” category. 

• About three quarters of the students (77 percent) were in the “agree” category (perception 
index of 2). Across the nation, 80 percent of the students were in this category. 

• About one quarter of the students in the District of Columbia (23 percent), versus 
20 percent across the nation, were in the “undecided, disagree” category (perception index 
of 3). 



41 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989). 

42 In the 1990 Trial State Assessment, students were asked five perception questions while in the 1992 Trial State Assessment, eight 

perception questions were asked, the five from 1990 plus three new questions. To compare the students’ perception indices from 
1990 to 1992, the same five statements were used to create the indices for both years. In addition, at the fourth-grade level, 
students could only respond “agree,” “undecided,” or “disagree.” Thus, for fourth grade, the perception index categories were 2 
and 3. i O O 
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And for grade 8: 



• Average mathematics proficiency was highest for students who were in the “strongly agree” 
category and lowest for students who were in the “undecided, disagree, strongly disagree” 
category. 

• Less than half of the students (41 percent) were in the “strongly agree” category (perception 
index of 1). Across the nation, 32 percent were in this category, and in the District of 
Columbia in 1990, 38 percent were in this category. 

• Some of the students in the District of Columbia (14 percent), versus 20 percent across the 
nation, were in the “undecided, disagree, or strongly disagree” category (perception index 
of 3). In 1990 in the District of Columbia, 14 percent of the students were in this category. 

• Compared to 1990, about the same percentage of eighth-grade students in 1992 were in the 
“strongly agree” category (38 percent in 1990 and 41 percent in 1992). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — "Strongly Agree” and “Strongly Disagree” were not response choices 
for Grade 4. A “perception index” of 1 represents very positive perceptions toward mathematics and a “perception index” of 3 
represents uncertain or negative perceptions toward mathematics. ! Interpret with caution - the nature of the sample does not 
allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer 
than 62 students). 
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SUMMARY 



Some out-of-school factors cannot be changed, but others can be altered in a positive way to influence a 
student’s learning and motivation. Partnerships among students, parents, teachers, and the community can 
affect the educational environment in the home, resulting in more out-of-school reading and an increased 
value placed on educational achievement, among other desirable outcomes. 



The data related to out-of-school factors for public-school students show that: 



• Grade 4 students in the District of Columbia who had all four types of reading materials (an 
encyclopedia, newspapers, magazines, and more than 25 books in the home) showed a 
higher mathematics proficiency than did students with zero to two types of materials. This 
is similar to the results for the grade 8 students in the District of Columbia, where students 
who had all four types of materials showed a higher mathematics proficiency than did 
students who had zero to two types. 

• Some of the fourth-grade students in the District of Columbia (16 percent) watched one 
hour or less of television each day; 37 percent watched six hours or more. 

• Relatively few of the eighth-grade students in the District of Columbia (7 percent) watched 
one hour or less of television each day; 31 percent watched six hours or more. In 1990, 
8 percent watched one hour or less of television each day while 33 percent watched six 
hours or more. 

• In grade 8, average mathematics proficiency was lowest for eighth-grade students who 
missed three or more days of school. 

• In grade 4, average mathematics proficiency was higher for students who were in the 
“agree” category than for students who were in the “undecided, disagree” category relating 
to students’ perceptions of mathematics. 

• In grade 8, average mathematics proficiency was highest for students who were in the 
“strongly agree” category and lowest for students who were in the “undecided, disagree, 
strongly disagree” category. 
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This appendix provides an overview of the technical details of the 1992 Trial State Assessment Program. 

It includes a discussion of the assessment design, the mathematics framework and objectives upon which 
the assessment was based, and the procedures used to analyze the results. 

The objectives for the assessment were developed through a consensus process managed by the Council of 
Chief State School Officers, and the items were developed through a similar process managed by 
Educational Testing Service. The development of the Trial State Assessment Program benefitted from the 
involvement of hundreds of representatives from State Education Agencies who attended numerous 
NETWORK meetings; served on committees; reviewed the framework, objectives, and questions; and, in 
general, provided important suggestions on all aspects of the program. 



Assessment Design 



The 1992 Trial State Assessment was based on a focused balanced incomplete block (BIB) spiral matrix 
design — a design that enables broad coverage of mathematics content while minimizing the burden for any 
one student. 

At grade 4, 158 mathematics items were developed for the assessment, including 53 regular 
constructed-response and five extended constructed-response items; at grade 8, 183 mathematics items were 
developed, including 59 regular constructed-response and six extended constructed-response items. To 
permit comparisons between the 1990 and 1992 assessments, 76 items at grade 8 that had been included in 
the 1990 assessment were also administered in the 1992 assessment. 

The first step in implementing the BIB design required dividing the entire set of mathematics items at each 
grade level into 13 units called blocks. Each block was designed to be completed in 15 minutes. The blocks 
were assembled into assessment booklets so that each booklet contained three background questionnaires 

— the first consisting of general background questions, the second comprising mathematics background 
questions, and the third containing questions about the students’ motivation to do well in the assessment 

— and three blocks of cognitive mathematics items. Students were given five minutes to complete each of 
the first two background questionnaires, 45 minutes to complete the three 15-minute blocks of mathematics 
items, and three minutes to complete the third background questionnaire. Thus, the first part of the 
assessment required approximately one hour of student time. 
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In accordance with the BIB design, the blocks were assigned to the assessment booklets so that each block 
appeared in exactly six booklets and each block appeared with every other block in one booklet. Twenty-six 
assessment booklets were used at each grade level for the Trial State Assessment Program. The booklets 
were spiraled or interleaved in a systematic sequence so that each booklet appeared an appropriate number 
of times in the sample. The students within an assessment session were assigned booklets in the order in 
which the booklets were spiraled. Thus, students in any given session received a variety of different booklets 
and only a small number of students in the session received the same booklet. Following this 
administration, all students were given a special booklet with the Estimation block. The Estimation items 
were administered using a 15-minute paced audiotape which made any direct calculations of answers 
difficult. Twenty multiple-choice Estimation items were administered at grade 4 and 22 at grade 8. 

Assessment Content 



The framework and objectives for the Trial State Assessment Program were developed using a broad-based 
consensus process, as described in the Overview to this report. 1 The assessment framework consisted of 
two dimensions: mathematical content areas and abilities. The five content areas assessed were Numbers 
and Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. Skills in Estimation were also measured (see Figure Al). 

The 1992 mathematics assessment included multiple-choice and regular constructed-response questions, as 
well as the use of calculators, manipulatives, and a paced audio-taped estimation section. The three 
mathematical ability areas assessed were Conceptual Understanding, Procedural Knowledge, and Problem 
Solving (see Figure A2). The information from the Estimation section is intended to supplement the data 
obtained from the Numbers and Operations and the Measurement questions administered using the more 
traditional paper-and-pencil or calculator approaches. 

The extended constructed-response questions required the students to formulate and demonstrate more 
detailed problem-solving skills, required up to about five minutes to complete, and were scored using a 
partial-credit model. Six examples of extended constructed-response questions used in the 1992 Trial State 
Assessment are provided, starting on page 124. Table Al, on page 123, gives the percentages of students 
attaining each of the score levels for the six example items. 



Data Analysis and Scales 



Once the assessments were conducted and information from the assessment booklets was compiled in a 
database, the assessment data were weighted to match known population proportions and adjusted for 
nonresponse. Analyses were then conducted to determine the percentages of students who gave various 
responses to each cognitive and background question. 

Item response theory (IRT) was used to estimate average mathematics proficiency for each jurisdiction and 
for various subpopulations, based on students’ performance on the set of mathematics items they received. 
IRT provides a common scale on which performance can be reported for the nation, each jurisdiction, and 
subpopulations, even when all students do not answer the same set of questions. This common scale makes 
it possible to report on relationships between students’ characteristics (based on their responses to the 
background questions) and their overall performance on the assessment. 
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1 See National Assessment of Educational Progress. Mathematics Objectives: 1990 Assessment. (Princeton, NJ: Educational 
Testing Service, 1988) for a description of the frameworks and objectives. 
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Numbers and Operations 



This content area focuses on students 1 understanding of numbers (whole numbers, fractions, decimals, integers) and their 
application to real-world situations, as well as computational and estimation situations. Understanding numerical relationships 
as expressed in ratios, proportions, and percents is emphasized. Students’ abilities in estimation, mental computation, use of 
calculators, generalization of numerical patterns, and verification of results are also included. 



Measurement 



This content area focuses on students’ ability to describe real-world objects using numbers. Students are asked to identify 
attributes, select appropriate units, apply measurement concepts, and communicate measurement-related ideas to others. 
Questions are included that require an ability to read instruments using metric, customary, or nonstandard units, with emphasis 
on precision and accuracy. Questions requiring estimation, measurements, and applications of measurements of length, time, 
money, temperature, mass/weight, area, volume, capacity, and angles are also included in this content area. 



This content area focuses on students’ knowledge of geometric figures and relationships and on their skills in working with this 
knowledge. These skills are important at all levels of schooling as well as in practical applications. Students need to be able 
to model and visualize geometric figures in one, two, and three dimensions and to communicate geometric ideas. In addition, 
students should be able to use informal reasoning to establish geometric relationships. 



Data Analysis, Statistics, and Probability 



This content area focuses on data representation and analysis across all disciplines and reflects the importance and 
prevalence of these activities in our society. Statistical knowledge and the ability to interpret data are necessary skills in the 
contemporary world. Questions emphasize appropriate methods for gathering data, the visual exploration of data, and the 
development and evaluation of arguments based on data analysis. 



Algebra and Functions 



This content area is broad in scope, covering algebraic and functional concepts in more informal, exploratory ways for the 
fourth and eighth grades. Proficiency in this content area requires both manipulative facility and conceptual understanding; it 
involves the ability to use algebra as a means of representation and algebraic processing as a problem-solving tool. Functions 
are viewed not only in terms of algebraic formulas, but also in terms of verbal descriptions, tables of values, and graphs. 



Estimation Skills 



Estimation involving whole numbers, fractions, and decimals pervades most of the content areas in mathematics. Presented 
using a paced audiotape procedure, questions assess students 1 abilities to make estimates appropriate to a wide variety of 
situations. Estimates take into consideration such factors as knowing when to estimate and whether to overestimate or 
underestimate in a particular problem. 
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figure A2 | Mathematical Abilities 
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Trial State Assessment 



The following three categories of mathematical abilities are not to be construed as hierarchical. For 
example, problem solving involves interactions between conceptual knowledge and procedural skills, but 
what is considered complex problem solving at one grade level may be considered conceptual understanding 
or procedural knowledge at another. 



Conceptual Understanding 



Students demonstrate conceptual understanding in mathematics when they provide evidence that they can recognize, label, 
and generate examples and counterexamples of concepts; can use and interrelate models, diagrams, and varied 
representations of concepts: can identify and apply principles; know and can apply facts and definitions; can compare, contrast, 
and integrate related concepts and principles; can recognize, interpret, and apply the signs, symbols, and terms used to 
represent concepts; and can interpret the assumptions and relations involving concepts in mathematical settings. Such 
understandings are essential to performing procedures in a meaningful way and applying them in problem-solving situations. 



Procedural Knowledge 



Students demonstrate procedural knowledge in mathematics when they provide evidence of their ability to select and apply 
appropriate procedures correctly, verify and justify the correctness of a procedure using concrete models or symbolic 
methods, and extend or modify procedures to deal with factors inherent in problem settings. Procedural knowledge includes 
the various numerical algorithms in mathematics that have been created as tools to meet specific needs in an efficient manner. 
It also encompasses the abilities to read and produce graphs and tables, execute geometric constructions, and perform 
noncomputational skills such as. rounding and ordering. 



Problem Solving 



In problem solving, students are required to use their reasoning and analytic abilities when they encounter new situations. 
Problem solving includes the ability to recognize and formulate problems; determine the sufficiency and consistency of data; 
use strategies, data, models, and relevant mathematics; generate, extend, and modify procedures; use reasoning (i.e., spatial, 
inductive, deductive, statistical, and proportional); and judge the reasonableness and correctness of solutions. 
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A scale ranging from 0 to 500 was created to report performance for each content area and for Estimation 
skills. The scales summarize examinee performance across all three item types used in the assessment 
(multiple-choice, regular constructed-response, and extended construct ed-response). In producing the 
scales, three distinct IRT models were used. Multiple-choice items were scaled using the three-parameter 
logistic model; regular constructed-response items were scaled using the two-parameter logistic model; and 
the extended constructed-response items were scaled using a generalized partial-credit model. Each 
content-area scale was based on the distribution of student performance across all three grades assessed in 
the 1990 national assessment (grades 4, 8, and 12) and had a mean of 250 and a standard deviation of 50. 
A composite scale was created as an overall measure of students’ mathematics proficiency. The composite 
scale was a weighted average of the five content area scales, where the weight for each content area was 
proportional to the relative importance assigned to the content area in the specifications developed by the 
Mathematics Objectives Panel. 



THE NATION’S 
REPORT 
CARD 



1992 



raep 



TABLE A 1 



Trial State Assessment 



EXAMPLE ITEM 1 
Pizza Comparison Grade 4 

District of Columbia 
Nation 

EXAMPLE ITEM 2 
Graph of Pockets Grade 4 

District of Columbia 
Nation 

EXAMPLE ITEM 3 
Laura Use Calculator Grade 4 

District of Columbia 
Nation 

EXAMPLE ITEM 4 
Marcy Dot Pattern Grade 6 

District of Columbia 
Nation 

EXAMPLE ITEM 5 
Treena's Budget Grade 8 

District of Columbia 
Nation 

EXAMPLE ITEM 6 
Radio Station Grade 8 

District of Columbia 
Nation 
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I Pizza Comparison 
I Grade 4 
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Extended Const ructed-Response Item: Numbers and Operations 



mm foifewihg question. a complete answer. You 

niay tise dfliwings, wor^ii and numbers to explain your answer. Be sure to 
show all of your work. 

Jose ate 1/2 of a pizza. 



Ella ate 1/2 of another pizza. £ 

Jose said that he ate more fiizZa than Ella, but Ella said that they both ate the 
same amount. Use words and pictures tp ^how that; Jose coiild be right. 
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EXAMPLE ITEM 1 
(continued) 



Pizza Comparison 
Grade 4 



Possible Correct Response 



This would be true when Jose’s: pizza is larger than E 


;|u’s : piz?aL of it 







Scoring Guide 



No response. 

Incorrect. The work is completely incorrect^ irrelevant, or I don’t know. 

Minimal. Student answers that 1/2 is always equal Also, references to the 
number of pizzas, or toppings, y i; : || :;J||||||||i 

Partial. Statements such as “Jose’s pizza had bigger pieces.” 

a picture: Witete :|iz^s :are ditt|fen^|btit;;i gives no 

HI explanation. §j§ 
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EXAMPLE ITEM 2 



Graphs of Pockets 
Grade 4 



Extended Constructed-Response Item: Data Analysis, Statistics, and Probability 



Think carefully about the fblibwii^ Question. Write Incomplete answer. You 


may use drawings, words, and number to explain your answer. Be sure to 


show all of your work. 


inhere are 20 students in Mr. Pang's class. On Tuesday most of the itudents 


in the class said they had pockets in the clothes they were wearmg- 
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EXAMPLE ITEM 2 
(continued) 



Graphs of Pockets 
Grade 4 



Extended Constructed-Response Item (continued) 



Which of the graphs most likely shows the number of pockets that each child 

..had? /yvtv.- . g '• • 

Explain why you chose that graph, 

Explain why you did not choose the other graphs. 

Possible Correct Response 

Graph B, because it had 20 students and most of the students had pockets? ; 1 

It could not be Cjfaph A because most of the students should have pockets. 

It could not be Graph C since there are more': than 20 students shown OR it 
is nofl likely :lh£i§ there; woufd be the samenumber of students: for each number 
of pockets OR most Clphes doh|| h'p|;|;0 pockets. 

Scoring Guide 



No response. 

Incorrect.! The work is completely incorrect, irrelevant, or I don’t; know. 

Minimal. The student chooses <§ratph B with no explanation OR the student 
chooses Graph A and Graph C with an explanation that shows some 
: understanding. 

Partial. The student chooses Graph B but does riot give an adequate 
explanation OR student chooses Graph B but gives no explanation why; 
student explains why it is not Graph COR why it is not Graph A, 

: Satisfactory:; The studeht chooses Graph B and gives a good explanation Why 
but does not mention the other graphs OR student gives a good explanation 
of why it cannot be Graph A and Graph C, but does not give a good 
explanation of why it is Graph B. 

Extended. The student chooses <3raph B and gives a reason why it cannot be 
the others. 
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EXAMPLE ITEM 3 | Laura Use Calculator 

I Grade 4 



Extended Constructed-Response Item: Numbers and Operations 



Laura wanted to enter the number 8375 into tier calculator, By mistake, she 
:-en^fed J -^2751 ealcu lator , how could she 

correct her mistake? 



Without clearihg the calculator; how could She : doirreCt her mistake another 
way? 



Did you use the calculator on this question? 



PIS: 



no: 
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EXAMPLE ITEM 3 
(continued) 



Laura Use Calculator 
Grade 4 



Possible Correct Response 



She could add 100 to the number in fie display: because she wanted a larger 
digit in the hundreds’ place QR |lie could also ai|d 50 two times (dr any other 
correct combination). ; 1 ||||| 



Scoring Guide 



No response. ■ : • 

Incorrect. The work is completely incorrect, irrelevant, or I don’t know. 



Minimal. Student’s response involves clearing the calculator with a method 
•other than using ; ON/C or C ;ior i CE . For 

on the new 



example: Refers to a memory-clearing bd-tton ( 
TT 108 calculator Of 



RM 



MRC 



/6h:|he old calculator). 



Partial. Student knows ydu need to add 1; to the 2 but has the wrong place 
value OR doesn’t mention place value OR subtracts 100 instead of aiding OR 
subtracts 16,650. 

Satisfactory: Student gives oifjy one correctljv&y. 

Extended. Student gives two correct wavs to change the number. 
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EXAMPLE ITEM 4 



Marcy Dot Pattern 
Grade 8 




Extended Constructed-Response Item: Algebra and Functions 



This question requires you to show your work and explain your reasoning. 
You may use drawings, words, and numbers in your explanation. Your answer 
should be clear enough so |hat; another person could read it and understand 
your thinking.: It is important thp you show all your work. ••• 

A pattern of dots is shown below. : At each step, more dots are added to the 
pai|efi(i: | i Tfe nuitiber ■ ;pf idpts||idded:^ at each Step is : .;ppr|f m ber 

added ih the previous step. The pattern continues infij^ 

||| lliiiltep)' ,| ' • -ft |:pnd|Step) : I;./ ■ I . (3r<I;Step): ; 



• • • 



Marcy has to determine the number of dots in the 20th step, but she does not 
want to draw all 20 pictures and then count the dots. 

Explain or show how she could do this and give the answer that Marcy should 
get for the number of dots. 



Did you use the calculator on this question? 

: Ves::--;:-:.; No 



• • t • 

• • » • 

t • f • 
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EXAMPLE ITEM 4 
(continued) 



Marcy Dot Pattern 
Grade 8 



Possible Correct Response 



Explanation should include one of ;the following ideas with no false statements. 

a. For each successive step, the number of rows and the number of columns 
is increasing by 1, forming a pattern. For example, the first step forms 
i-by-2 rows and columns, the next step 2-by-3, the third step 3-by-4, and 
so on. Continuing this pattern would tnean that! the 26th step has 20 x 21 
dots or 420 dots. 

b. Look at successive dif^ehehdies l^ttwbn scpnsecuflve steps.: llfie differences 

i 4, 6, 8, 10*.. form a pattern. Thefe are 19 differences forming the pattern V 
4, 6, 8, 10, ..., 4|, 40 and this sum is (9 x 44) + 22 or 418. However, 2 
must be added for the first step, yielding a response of 420. 



Scoring Guide 



No response. 

Incorrect. The work is completely incorrect, irrelevant, or I don’t know. 

Minimal. An attempt to generalize or to draw all 20 pictures in the pattern 
(with a clear understanding of the pattern). 

Partial. A partial (incomplete) correct explanation. 

Satisfactory. Correct explanation; of pattern but does not include or omits the 
correct number of dots (420), -'Mf. 

Extended. Correct answer. 
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Treena’s Budget 
Grade 8 



Trial State Assessment 



Extended Constructed-Response Item: Numbers and Operations 



This question requires you to show your work and explain your reasoning. 
You may use drawings, words, and numbers in your explanation! ; Your answer 
Should be clear enough so that another person could read it and understand 
thinking. It is important that you show all your work. 



Treena won a 7-day scholarship worth $1,000 to the Pro Shot Basketball camp. 
Round-trip travel expenses to the camp are $335 by air or S125 b’ 
the camp she must choose between a week of individual instruction at 
day or a week of group instruction at $40 per day. Treena -s food and other 
expenses are fixed at $45 per day. If she does not plan to spend any money 
other than the scholarship, what are all choices of travel and instruction plans 
that she Could afford to make? 

Explain your reasoning; 



Did you use the calculator On this question? 
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EXAMPLE ITEM 5 
(continued) 



Treena’s Budget 
Grade 8 



Possible Correct Response 



Treena’s fixed expenses Will be 7 x $45 - $315:forthe 7 days. Therefore, she has $1,000 
- $31 5 = ;::$685: to spend for instructioii and travel ; The group: plan : will cost 7 x : $40 $280; 

while the individual .j5^' : \^.'cc)st 7 x $60 = $420. Treena has 3 Options:; |||l||llllllllllll| 

Group and Train: $280 + $125 = $405 

; ;^oyp^fl^l^ane:;H r; : : $280 +. : $335 • $61 5: ^illlllllllllll 

Individual and Train: $420 + $125 = $545 

$he cannot choose : tbe; : mdiyjduai planismd travel by plane becatise; be 
$1,070 which is greater than the allotted scholarship.!! 1 :;; 

Any full -credit response pearly pomfounicate^t^ has ^options, what the 3 option? are, 

and how the student arrived at the 3 options. 



Scoring Guide 



No response!; 



Incorrect. The 



work; is completely incorrect, : 



b) Student Work contains; 
F or example ;:lthe istuiten t 



irrelevaht^pr 1 don’t know. 



Minimal, a) Student indicated conclusion^ with no mathematical evidence OR 

major mathematical 

does not consider Treeiia’s fixed expenses|p 



Partial! ay Student indicates T; pFsipofe^ correet cohcliisjohs, btit the Work 
; containssome ; : 'OlK 
but indicates no conclusion . 



is uheiear 



Satisfactory; a) Student 8hoW3 
3 choices, but the explanation 
correct mathematical evidence for any 
explanation is clear and 'complete. : ! 



CofrectlffiatheMafi eyideriee thatT 



OF incomplete 



Extended. 

explanation; 



Full-credit 



of Tfeeha^s 



response: correct ' • solution ; : and 



OR 



p); Sltidcnt shows 



choices 



the 



complete. 
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EXAMPLE ITEM 6 



Radio Station 
Grade 8 



Extended Constructed-Response Item: Geometry 



This question requires you tb show your work and explain your reasoning. 

: You may use drawings, words, and Your answer 

should be plear enqiigh so that another person coiild ; read jit and understand 
your thinking. It is important thatjypu show all your work. 

Radio station KMAT in Math City is 200 miles from radio station KGEQ in 
Geometry City. I|ighway 7, a straight road, connects the two cities. 

KMAT broadcasts can be received ftp to L50 miles jih all directions from the 
station and KGEO broadcasts can be received up to 125 miles in all directions.; 
Radio wayeiS: trav:p|jliOm each |a||o:s||||Ph through |jfre air, as represented 
below. -11 111 illliiS*! • - 111 . ’-I • 1 • 






Radio' 
Station 



(Hi 



' > !<i: 



-Radio 



I : I ; 1 



On the next page, draw a diagram that shows the fbllowinglltljjp 

;tli; • . Highway 7 _ I!! ^ ; 

• The location of the two radio stations i"; . 

• The part of Highway 7 i^ipth radlii> stations can be received 



Be sure to label the distances along the highway and the length in miles of the 
part of the highway where both stations cah;;;be received. 



o 

ERJC 



140 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



District of Columbia 






THE NATION’S 
REPORT 
CARD 



rmp 




1982 

Trial State Assessment 



EXAMPLE ITEM 6 
(continued) 



Radio Station 
Grade $ 



Possible Correct Response 



200 Miles 




V50?^' 



pill 

Wife 



KMAT 
(Math City) 



Highway 2 



•75 Miles 



a 






akGEO 

GecKnetry 

City 



\ Area where both 
stations can be 

£ . ifeceived. P ' ’ • 

There is a 75-mile part of'Hi^jwly tidi: it aiea^ pir 

starts 75 miles outside Math City and ends 150 miles outside Math f|i| 



Scoring Guide 



No response. 

Incorrect. The work Is completely incorrect, irrelevant, or 1 don’t know. 

Minimal. Map with Cities, highway, and 200 miles labeled (or some indication 
of scale) OR map that uses some, but not aU of the given information. 

Partial. Map frith ci|ifrs, |ig|tyay, and 2QG miles; labeled (or sotne indication 
of scale) AND identifies incorrect common broadcast area (e.g., not on 
Highway 7) or insufficiently an areaS-j<^§0. 

Satisfactory! ; Map witli cities, highway, and 200 miles labeled and identifies 
common broadcast area on Highway | but omits or incorrectly computes 
length of common area. 

Extended. Correct answer. ■■ ■ . ■ ■ ■ 
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Questionnaires for Teachers and Schools 



As part of the Trial State Assessment, questionnaires were given to the mathematics teachers of assessed 
students and to the principal or other administrator in each participating school. 

A Background Panel drafted a set of issues and guidelines and made recommendations concerning the 
design of these questionnaires. For the 1992 assessment, the teacher and school questionnaires focused on 
five educational areas: instructional content, instructional practices and experiences, teacher characteristics, 
school conditions and context, and conditions beyond school (i.e., home support, out-of-school activities, 
and attitudes). Similar to the development of the materials given to students, the guidelines and the teacher 
and school questionnaires were prepared through an iterative process that involved extensive development, 
field testing, and review by external advisory groups. 

It is important to note that in this report, as in all NAEP reports, the student is always the unit of analysis, 
even when information from the teacher or school questionnaire is being reported. Having the student as 
the unit of analysis makes it possible to describe the instruction received by representative samples of fourth- 
or eighth-grade students in public schools. Although this approach may provide a different perspective from 
that which would be obtained by simply collecting information from a sample of fourth- or eighth-grade 
mathematics teachers or from a sample of schools, it is consistent with NAEP’s goal of providing 
information about the educational context and performance of students. 



MATHEMATICS TEACHER QUESTIONNAIRE 

The questionnaires for fourth- and eighth-grade mathematics teachers consisted of two parts. The first 
requested information about the teacher, such as race/ethnicity and gender, as well as academic degrees held, 
teaching certification, training in mathematics, and ability to get instructional resources. In the second part, 
teachers were asked to provide information on each class they taught that included one or more students 
who participated in the Trial State Assessment Program. The information included, among other things, 
the extent to which textbooks or worksheets were used, the instructional emphasis placed on different 
mathematical topics, and the use of various instructional approaches. Because of the nature of the sampling 
for the Trial State Assessment, the responses to the mathematics teacher questionnaire do not necessarily 
represent all fourth- and eighth-grade mathematics teachers in a state or territory. Rather, they represent 
the teachers of the particular students being assessed. 



SCHOOL CHARACTERISTICS AND POLICIES QUESTIONNAIRE 

An extensive school questionnaire was completed by principals or other administrators in the schools 
participating in the Trial State Assessment. In addition to questions about the individuals who completed 
the questionnaires, there were questions about school policies, course offerings, and special priority areas, 
among other topics. 
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Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students at or above particular 
achievement levels, and percentages of students responding in certain ways to background questions) are 
estimates of the corresponding information for the population of fourth- or eighth-grade students in public 
schools in a state. These estimates are based on the performance of carefully selected, representative samples 
of fourth- and eighth-grade public-school students from the state or territory. 

If a different representative sample of students were selected and the assessment repeated, it is likely that the 
estimates might vary somewhat, and both of these sample estimates might differ somewhat from the value 
of the mean or percentage that would be obtained if every fourth- or eighth-grade public-school student in 
the state or territory were assessed. Virtually all statistics that are based on samples (including those in 
NAEP) are subject to a certain degree of uncertainty. The uncertainty attributable to using samples of 
students is referred to as sampling error. 

Like almost all estimates based on assessment measures, NAEP’s total group and subgroup proficiency 
estimates are subject to a second source of uncertainty, in addition to sampling error. As previously noted, 
each student who participated in the Trial State Assessment was administered a subset of questions from 
the total set of questions. If each student had been administered a different, but equally appropriate, set 
of the assessment questions — or the entire set of questions — somewhat different estimates of total group 
and subgroup proficiency might have been obtained. Thus, a second source of uncertainty arises because 
each student was administered a subset of the total pool of questions. 

In addition to reporting estimates of average proficiencies, proportions of students at or above particular 
achievement levels, and proportions of students giving various responses to background questions, this 
report also provides estimates of the magnitude of the uncertainty associated with these statistics. These 
measures of the uncertainty are called standard errors and are given in parentheses in each of the tables in 
the report. The standard errors of the estimates of mathematics proficiency statistics reflect both sources 
of uncertainty discussed above. The standard errors of the other statistics (such as the proportion of 
students answering a background question in a certain way or the proportion of students in certain 
racial/ethnic groups) reflect only sampling error. NAEP uses a methodology called the jackknife procedure 
to estimate these standard errors. 

The reader is reminded that, like all surveys, NAEP results are also subject to other kinds of errors including 
the effects of necessarily imperfect adjustment for student and school non-response and other largely 
unknowable effects associated with the particular instrumentation and data collection methods used. 
Nonsampling errors can be attributed to a number of sources: inability to obtain complete information 
about all selected students in all selected schools in the sample (some students or schools refused to 
participate, or students participated but answered only certain items); ambiguous definitions; differences in 
interpreting questions; inability or unwillingness to give correct information; mistakes in recording, coding, 
or scoring data; and other errors of collecting, processing, sampling, and estimating missing data. The extent 
of nonsampling errors is difficult to estimate. By their nature, the impact of such errors cannot be reflected 
in the data-based estimates of uncertainty provided in NAEP reports. 



Drawing Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences about the overall population 
of fourth- and eighth-grade students in public schools in each participating state and territory based on the 
particular sample of students assessed. One uses the results from the sample — taking into account the 
uncertainty associated with all samples - to make inferences about the population. 
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The use of confidence intervals , based on the standard errors, provides a way to make inferences about the 
population means and proportions in a manner that reflects the uncertainty associated with the sample 
estimates. An estimated sample mean proficiency ± 2 standard errors approximates a 95 percent confidence 
interval for the corresponding population quantity. This means that with approximately 95 percent 
confidence, the average performance of the entire population of interest (e.g., all eighth-grade students in 
public schools in a state or territory) is within ± 2 standard errors of the sample mean. 

As an example, suppose that the average mathematics proficiency of the students in a particular state’s 
eighth-grade sample were 256 with a standard error of 1.2. A 95 percent confidence interval for the 
population quantity would be as follows: 

Mean ± 2 standard errors = 256 ± 2 • (1.2) = 256 ± 2.4 = 

256 * 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average proficiency for the entire population 
of eighth-grade students in public schools in that state is between 253.6 and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the percentages are not 
extremely large (greater than 90 percent) or extremely small (less than 10 percent). For extreme 
percentages, confidence intervals constructed in the above manner may not be appropriate and procedures 
for obtaining accurate confidence intervals are quite complicated. 



Analyzing Subgroup Differences in Proficiencies and Proportions 

In addition to the overall results, this report presents outcomes separately for a variety of important 
subgroups. Many of these subgroups are defined by shared characteristics of students, such as their gender, 
race /ethnicity, and the type of community in which their school is located. Other subgroups are defined 
by students’ responses to background questions. Still other subgroups are defined by the responses of the 
assessed students’ mathematics teachers to questions in the mathematics teacher questionnaire. 

As an example, one might be interested in answering the question: Do students who reported spending 45 
minutes or more doing mathematics homework each day exhibit higher average mathematics proficiency than 
students who reported spending 15 minutes or less? 

To answer the question posed above, one begins by comparing the average mathematics proficiency for the 
two groups being analyzed. If the mean for the group that reported spending 45 minutes or more on 
mathematics homework is higher, one may be tempted to conclude that that group does have higher 
achievement than the group that reported spending 15 minutes or less on homework. However, even 
though the means differ, there may be no real difference in performance between the two groups in the 
population because of the uncertainty associated with the estimated average proficiency of the groups in the 
sample. Remember that the intent is to make a statement about the entire population, not about the 
particular sample that was assessed. The data from the sample are used to make inferences about the 
population as a whole. 
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As discussed in the previous section, each estimated sample mean proficiency (or proportion) has a degree 
of uncertainty associated with it. It is therefore possible that if all students in the population had been 
assessed, rather than a sample of students, or if the assessment had been repeated with a different sample 
of students or a different, but equivalent, set of questions, the performances of various groups would have 
been different. Thus, to determine whether there is a real difference between the mean proficiency (or 
proportion of a certain attribute) for two groups in the population, one must obtain an estimate of the 
degree of uncertainty associated with the difference between the proficiency means or proportions of those 
groups for the sample. This estimate of the degree of uncertainty — called the standard error of the 
difference between the groups — is obtained by taking the square of each group’s standard error, summing 
these squared standard errors, and then taking the square root of this sum. 

Similar to the manner in which the standard error for an individual group mean or proportion is used, the 
standard error of the difference can be used to help determine whether differences between groups in the 
population are real. The difference between the mean proficiency or proportion of the two groups ± 2 
standard errors of the difference represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, one should conclude that there is insufficient evidence to claim a real difference 
between groups in the population. If the interval does not contain zero, the difference between groups is 
statistically significant (different) at the .05 level. 

As an example, suppose that one were interested in determining whether the average mathematics 
proficiency of eighth-grade females is higher than that of eighth-grade males in a particular state’s public 
schools. Suppose that the sample estimates of the mean proficiencies and standard errors for females and 
males were as follows: 



Group 


Average 


Standard 


Proficiency 


Error 


Female 


259 


2.0 


Male 


255 


2.1 



The difference between the estimates of the mean proficiencies of females and males is four points (259 - 
255). The standard error of this difference is 



V 2.0 2 + 2.1 2 = 2.9 

Thus, an approximate 95 percent confidence interval for this difference is 

Mean difference ± 2 standard errors of the difference = 

4 ± 2 • (2.9) = 4 ± 5.8 = 4 - 5.8 and 4 + 5.8 = (-1.8, 9.8) 

The value zero is within this confidence interval, which extends from -1.8 to 9.8 (i.e., zero is between -1.8 
and 9.8). Thus, one should conclude that there is insufficient evidence to claim a difference in average 
mathematics proficiency between the population of eighth-grade females and males in public schools in the 
state. 2 



3 The procedure described above (especially the estimation of the standard error of the difference) is, in a strict sense, only 
appropriate when the statistics being compared come from independent samples. For certain comparisons in the report, the 
groups were not independent. In those cases, a different (and more appropriate) estimate of the standard error of the difference 
was used. 
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Throughout this report, when the mean proficiencies or proportions for two groups were compared, 
procedures like the one described above were used to draw the conclusions that are presented. If a statement 
appears in the report indicating that a particular group had higher ( or lower ) average proficiency than a 
second group, the 95 percent confidence interval for the difference between groups did not contain zero. 
When a statement indicates that the average proficiency or proportion of some attribute was about the same 
for two groups, the confidence interval included zero, and thus no difference could be assumed between the 
groups. The information described in this section also pertains to comparisons between 1990 and 1992. 
The reader is cautioned to avoid drawing conclusions solely on the basis of the magnitude of the differences. 
A difference between two groups in the sample that appears to be slight may represent a statistically 
significant difference in the population because of the magnitude of the standard errors. Conversely, a 
difference that appears to be large may not be statistically significant. 

The procedures described in this section, and the certainty ascribed to intervals (e.g., a 95 percent confidence 
interval), are based on statistical theory that assumes that only one confidence interval or test of statistical 
significance is being performed. However, in each chapter of this report, many different groups are being 
compared (i.e., multiple sets of confidence intervals are being analyzed). When one considers sets of 
confidence intervals, statistical theory indicates that the certainty associated with the entire set of intervals 
is less than that attributable to each individual comparison from the set. If one wants to hold the certainty 
level for the set of comparisons at a particular level (e.g., .95), adjustments (called multiple comparison 
procedures) must be made to the methods described in the previous section. One such procedure — the 
Bonferroni method -- was used in the analyses described in this report to form confidence intervals for the 
differences between groups whenever sets of comparisons were considered. Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those described on the previous 
pages. A more detailed description of the use of the Bonferroni procedure appears in the Trial State 
Assessment technical report. 



Statistics with Poorly Determined Standard Errors 

The standard errors for means and proportions reported by NAEP are statistics and therefore are subject 
to a certain degree of uncertainty. In certain cases, typically when the standard error is based on a small 
number of students, or when the group of students is enrolled in a small number of schools, the amount 
of uncertainty associated with the standard errors may be quite large. Throughout this report, estimates 
of standard errors subject to a large degree of uncertainty are followed by the symbol In such cases, 
the standard errors — and any confidence intervals or significance tests involving these standard errors -- 
should be interpreted cautiously. Further details concerning procedures for identifying such standard errors 
are discussed in the Trial State Assessment technical report. 
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Minimum Subgroup Sample Sizes 

Results for mathematics proficiency and background variables were tabulated and reported for groups 
defined by race/ethnicity, type of school community, gender, and parents’ education level. NAEP collects 
data for five racial/ethnic subgroups (White, Black, Hispanic, Asian/Pacific Islander, and American 
Indian/ Alaskan Native), four types of communities (Advantaged Urban, Disadvantaged Urban, Extreme 
Rural, and Other Communities), and five levels of parents’ education (Graduated College, Some Education 
After High School, Graduated High School, Did Not Finish High School, and I Don’t Know). However, 
in many states or territories, and for some regions of the country, the number of students in some of these 
groups was not sufficiently high to permit accurate estimation of proficiency and/or background variable 
results. As a result, data are not provided for the subgroups with very small sample sizes. For results to 
be reported for any subgroup, a minimum sample of 62 students was required. For statistical tests 
pertaining to subgroups or to a trend from 1990 to 1992, the sample size for both groups had to be at least 
62. This number was determined by computing the sample size required to detect an effect size of .2 
total-group standard deviation units with a probability of .8 or greater. 

The effect size of .2 pertains to the true difference between the average proficiency of the subgroup in 
question and the average proficiency for the total fourth- or eighth-grade public- school population in the 
state or territory, divided by the standard deviation of the proficiency in the total population. If the true 
difference between subgroup and total group mean is .2 total-group standard deviation units, then a sample 
size of at least 62 is required to detect such a difference with a probability of .8. Further details about the 
procedure for determining minimum sample size appear in the Trial State Assessment technical report. 

Describing the Size of Percentages 



Some of the percentages reported in the text of the report are given quantitative descriptions. For example, 
the number of students being taught by teachers with master’s degrees in mathematics might be described 
as “relatively few” or “almost all,” depending on the size of the percentage in question. Any convention 
for choosing descriptive terms for the magnitude of percentages is to some degree arbitrary. The descriptive 
phrases used in the report and the rules used to select them are shown below. 



Percentage 


Description of Text in Report 


p = 0 


None 


0 < p < 10 


Relatively few 


10 < p < 20 


Some 


20 < p < 30 


About one quarter 


30 < p < 44 


Less than half 


44 < p < 55 


About half 


55 < p < 69 


More than half 


69 < p < 79 


About three quarters 


79 < p < 89 


Many 


89 < p < 100 


Almost all 


p = 100 


All 



Tl 
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Reanalysis of 1990 Results 

An enhanced version of the statistical procedures employed in 1990 was used to obtain results for the 1992 
mathematics assessment. Preliminary research with simulated data and experience with selected reanalyses 
of previously reported 1990 NAEP data sets suggested that small, but consistent, differences in the results 
produced by the two sets of procedures would be obtained. The nature and magnitude of such differences 
would have little or no effect on state-to-state and state-to-nation comparisons. However, certain 
within-state comparisons between 1992 and 1990 would be affected to a degree that is not ignorable. 

In order to maintain the integrity of the 1990 NAEP mathematics scales for trend analysis, a decision was 
made to reanalyze the 1990 results and report revised figures. The 1990 estimates given in the 1992 state 
reports are based on the reanalyzed 1990 results. In the vast majority of cases, the reanalyzed results will 
differ trivially, if at all, from those originally reported and the magnitudes of the differences between the 
original and reanalyzed results rarely exceed a standard error. Slightly larger, but still modest, differences 
between the original and reanalyzed results may be observed for the composite-scale standard deviations and 
proportions of students at or above NAEP anchor levels. 
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Setting achievement levels is a method for setting standards on the NAEP assessment that identifies what 
students should know and should be able to do at various points along the proficiency scale. The method 
depends on securing and summarizing a set of judgmental ratings of expectations for student educational 
performance on specific items. The NAEP proficiency scale is a numerical index of students’ performance 
in mathematics ranging from 0 to 500 and has three achievement levels -- Basic, Proficient, and Advanced 
— mapped onto it for each grade level assessed. 



In developing the threshold values for the levels, a broadly constituted panel of judges -- including teachers 
(50 percent), non-teacher educators (20 percent), and non-educators (30 percent) -- rated a grade-specific 
item pool using the Board’s policy definitions for Basic, Proficient, and Advanced. 1 The policy definitions 
are as follows: 



BASIC 



PROFICIENT 



ADVANCED 



This level, below Proficient, denotes partial mastery of the knowledge and skills that are 
fundamental for proficient work at each grade. 

This central level represents solid academic performance for each grade tested. Students 
reaching this level have demonstrated competency over challenging subject matter and 
are well prepared for the next level of schooling. 

This higher level signifies superior performance beyond proficient grade-level mastery at 
each grade. 



The policy definitions were operationalized by the judges in terms of specific mathematical skills, 
knowledge, and behaviors that were in accordance with the current mathematics assessment framework, and 
were generally agreed to be appropriate expectations for students in each grade at each level. The judges’ 
operationalized definitions were incorporated into lists of descriptors that represented what borderline 
students should be able to do at each of the policy levels. The purpose of having panelists develop their 
own operational definitions of the achievement levels was to ensure that all panelists would have a common 
understanding of borderline performances and a common set of content-based referents to use during the 
item-rating process. 



1 Non-educators represented business, labor, government service, parents, and the general public. 
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The judges (24 at grade 4 and 22 at grade 8) each rated half of the items in the NAEP pool in terms of the 
expected probability that a student at a borderline achievement level would answer the item correctly, based 
on the judges’ operationalization of the policy definitions and the factors that influence item difficulty. To 
assist the judges in generating consistently-scaled ratings, the rating process was repeated twice, with 
feedback. Information on consistency among different judges and on the difficulty of each item 2 was fed 
back into the first repetition (round 2), while information on consistency within each judge’s set of ratings 
was fed back into the second repetition (round 3). The third round of ratings permitted the judges to 
discuss their ratings among themselves to resolve problematic ratings. The mean final rating of the judges 
aggregated across items yielded the threshold values in the percent correct metric. These cut scores were 
then mapped onto the NAEP scale (which is defined and scored using item response theory, rather than 
percent correct) to obtain the scale scores for the achievement levels. The judges’ ratings, in both metrics, 
and their associated errors of measurement are shown below. The Board accepted the panel’s achievement 
levels and, for reporting purposes, set final cutpoints one standard error (a measure of consistency among 
the judges’ ratings) below the mean levels. 



figure Ll | Cutpoints for Achievement Levels 
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4 


Advanced 


84 
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4.0 
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8 


Basic 


48 


258 


2.4 


256 


8 


Proficient 


71 


300 


5.7 


294 


8 


Advanced 


87 


336 


4.8 


331 



After the ratings were completed, the judges for each grade level reviewed the operationalized descriptions 
developed by the judges of the other grade levels as well as their own descriptions and came up with 
achievement level descriptions that were generally acceptable to all three grade-group judges. However, the 
descriptions varied in format, sharpness of the language, and degree of specificity of the statements. 
Therefore, another panel at a subsequent validation meeting improved the wording and modified the 
language of the achievement level descriptions to reflect more closely the terminology of the NCTM 
standards for mathematics. 3 



2 Item difficulty estimates were based on a preliminary, partial set of responses to the national assessment. 



3 Curriculum and Evaluation Standards for School Mathematics . (Reston, Va: National Council of Teachers of Mathematics, 1989). 
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Finally, for each achievement level, exemplar items needed to be selected that reflected the kinds of tasks 
that examinees at or above the level were likely to be able to perform successfully. While the judges 
discussed items and made recommendations, the task of final selection was put to a subsequent validation 
panel. Several criteria were used to select items as candidates for exemplars. From the pool of items 
scheduled for public release, items were deleted that students at any level were more likely to get wrong than 
right (expected p- value ^ .50). Remaining items that did not match any of the descriptions were also 
deleted. A few items were deleted that did not have increasing p-values from Basic, to Proficient, to 
Advanced. The validation panels then reviewed the matched and classified item sets and selected exemplars 
based on the quality of the items, the way the items collectively represented the subscales, and the 
appropriateness of the items to the grade (for items administered to more than one grade). In Chapter 1, 
Figure 2 provides the final descriptions of the six achievement levels for grades 4 and 8, along with 
exemplar items to illustrate what students at each level should be able to perform. In principle, the 
descriptions of the levels, though based on the 1992 item pool, apply to the current assessment framework 
and will not change from year to year (that is, until the framework changes). However, the sample items 
reflective of the levels will need to be updated each time the assessment is administered. Table 4 in 
Chapter 1 provides the percentage of students at or above each of the six levels and the percentage of 
students below the Basic level for each grade. 
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Scale anchoring is a method for defining performance along a proficiency scale to characterize what students 
know and can do at each level that differentiates them from students performing at lower levels. NAEP 
summarized students’ overall mathematics performance on a 0 to 500 proficiency scale anchored at four 
points -- level 200, 250, 300, and 350. 1 

To develop the descriptions of the skills, knowledge, and understandings that characterize each anchor level, 
NAEP used the 1990 and 1992 assessment results to identify sets of questions typically answered correctly 
by most students at a particular level but answered incorrectly by a majority of students at the next lower 
level. The criteria for selecting these “benchmark” questions are as follows: 

• To define performance at level 200, items were chosen that were answered correctly by at 
least 65 percent of the students whose proficiency was at or near 200 on the scale. 

• To define performance at each of the higher levels on the scale, items were chosen that were: 
a) answered correctly by at least 65 percent of the students whose proficiency was at or near 
that level; and b) answered incorrectly by a majority (at least 50 percent) of the students 
performing at or near the next lower level. 

• The percentage of students at a level who answered the item correctly had to be at least 30 
points higher than the average percentage of students at the next lower level who answered 
it correctly. 

Once these empirically selected sets of questions had been identified, the four sets of anchor questions were 
studied by a panel of mathematics educators to characterize the types of knowledge, skills, and reasoning 
abilities needed to answer each set of questions. Each of the four anchor levels was defined by describing 
the types of mathematics questions that most students attaining that anchor level would be able to perform 
successfully. 

Figure SI provides a definition of the four anchor levels. Table SI provides the percentages of students at 
or above each of the four anchor levels. It is important to note that the definitions of these levels are based 
solely on the results from the 1990 and 1992 national mathematics assessments of fourth-, eighth-, and 
twelfth-grade students. The levels are not judgmental standards of what ought to be achieved at a particular 
grade. 



0 



Defining anchor levels below 200 and above 350 is theoretically possible; however, so few students performed at the extreme ends 
of the scale that it was impractical to define meaningful levels of mathematics proficiency beyond the four presented here. 
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figure si | Levels of Mathematics Proficiency 




Trial State Assessment 





Addition and Subtraction, and Simple Problem Solving with Whole Numbers 


200|||!|f 





Students at or above this level can identify solutions to one-step word problems involving addition or subtraction. They can 
add and subtract whole numbers in most situations, and when a calculator is available, they can multiply and divide. They are 
able to select the largest whole number from a set of numbers in the thousands, and can match the verbal and symbolic names 
for numbers. 

Students demonstrated familiarity with length and weight by selecting appropriate instruments and units to measure these 
attributes. They are able to recognize some basic properties of two-dimensional geometric figures as well as the names of 
standard examples of these figures. They can extend simple patterns. 



ilttaJii 






Multiplication and Division, Simple Measurement, and Two-Step Problem Solving 



When presented with a problem situation, students at or above this level have some understanding of the problem, can identify 
extraneous information, and have some knowledge of when to use computational estimation. They have an understanding of 
addition, subtraction, multiplication, and division with whole numbers. They can solve one- and simple two-step problems 
involving whole numbers. They are able to round whole numbers and solve simple word problems involving place value, 
estimation, and multiples. 



Students can use a ruler to measure length in centimeters and have some understanding of area and perimeter. They can 
solve simple problems using readings from instruments. They demonstrate a knowledge of properties of triangles, squares, 
rectangles, circles, and cubes. They can solve problems that require visualizing, drawing, or manipulating simple geometric 
shapes. They are able to complete bar graphs and pictographs, as well as use information from graphs or tables to solve 
simple problems. They can recognize simple number patterns, are beginning to deal informally with the idea of a variable, and 
have some knowledge of simple probability. 
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FIGURE si | Levels of Mathematics Proficiency 
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: Reasoning and Problem Solving Involving Fractions, Decimals, Percents, and 
; 300 Elementary’ Concepts in Geometry, Statistics, and Algebra 

Students at or above this level can use various strategies and explain their reasoning in a variety of problem solving situations. 
They are able to solve problems involving not only whole numbers but also decimals and fractions. They can represent and 
find equivalent fractions and use these concepts in solving routine problems. They can find percents of a number and use this 
skill in simple problems. Multiplication and division of whole numbers have developed to the extent that students can use all 
four operations in multi-step problems. 

Students can read and use instruments in more complex situations. They can find areas of rectangles, recognize relationships 
among common units of measure, and solve routine problems involving similar triangles and scale drawings. They have 
knowledge of definitions and properties of simple geometric figures in the plane. Their spatial sense includes the ability to 
visualize a cube in either three-space or its flattened form in a plane. 

Students can calculate averages, select and interpret data from a variety of graphs, list the possible arrangements in a sample 
space, find the probability of a simple event, and have a beginning understanding of sample bias. They can use knowledge of 
relative frequencies in simple simulation situations. Students show the ability to evaluate simple expressions and solve linear 
equations. Students can graph points on coordinate axes, locate the missing coordinates for a corner of a square, and identify 
which ordered pairs satisfy a given linear equation. 



jfiP- 

350 



ilJ ij 



Reasoning and Problem Solving Involving 
Functions 



Geometric Relationships, Algebra, and 



Students at or above this level can reason and estimate with percents. They can recognize scientific notation and find the 
decimal equivalent. They can apply their knowledge of area and perimeter of simple geometric figures to solve problems. 
They can find the circumferences of circles and the surface areas of solid figures. They can solve for the length of missing 
segments in more complex similarity situations. Students can apply the Pythagorean Theorem to .find the hypotenuse of a right 
triangle. They are beginning to use rectangular coordinates in problem solving situations and can apply geometric properties 
and relationships in solving problems. 



Students can compute means from frequency tables, create a sample space to determine probabilities, and read the graph of 
a step-function. Students can use exponents and evaluate expressions given in functional notation. In number theory, they 
have an understanding of even and odd numbers and their properties. They can identify an equation describing a linear 
relation provided in a table, and solve literal equations and systems of two linear equations. They have some knowledge of 
trigonometric relations. These students can represent and interpret complex patterns and data using numbers, expressions, 
and graphs. Given the graph of a function, they can identify its zeros and the effect on the graph of taking the absolute value 
of the function. 
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TABLE si I Levels of Fourth-Grade and Eighth-Grade 
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« v 87 ( r.6) «‘M ll ‘ 


^ 87)( 4 ,6) ‘ 


Nation 












‘w icjs) :S| 


Some college 
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■ l ft . { ***** jjY 
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; v 66|j(|B|H 
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98 (0.6). 
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“ *!7 Y , ‘ 1 


‘ < c« '* S 




t « ‘ < u * 5 ,)i c | { 


'* " , F t { *' ' *c' ‘c. 


. ;'VvJ 5 
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"M $ ( 0 j$).i 
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84(1.4) 


84 { (\l f .4) C ll| 1 
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.j : v 




ISiltSini 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population of 
interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one 
must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) appears, it signifies that the 
value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to 
permit a reliable estimate (fewer than 62 students). 
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For each of the tables in the main body of the report that presents mathematics proficiency results, this appendix 
contains corresponding data for each level of the four reporting subpopulations -- race/ethnicity, type of 
community, parents’ education level, and gender. 
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Eighth-grade Mathematics 


Pre-atgebra 


Algebra 


1990 Grade 8 


1992 Grade 8 


1990 Grade 8 


1992 Grade 8 


1990 Grade 8 


1992 Grade 8 
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Average Math Proficiency 
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.+■*■* ^ •* j 


I ' r V*' ■«: 


*** 


Nation 
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< iu 


r 9 ( 0.8) 


CiSpilpiWi^ai 
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!' 11 '('3^ I 
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|p|i| ( 2.9)! ?: || . 


Disadv. urban 


{ , \ « ! !,t ' «; 


1 * * , { ,* ’ , « £ r • t- , 


« V ‘ ’ « , i 


s ; t -‘. . • ' 




wj! :4 aiiji! A ■’ & 


State 


58 (i.2) ' 


: v ' 42 ( 2,0)' < '/ • 


1:: 8 (0,8) “ 


18 ( 1;4) < 


! : 31y( 


■'yr> 37 ( 1.8) ■■■'f'r: 
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111IIII264 ( Wl . , . ' 
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(continued on next page) 
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TABLE A16 I Eighth-Grade Students’ Reports on the 
(continued) I Mathematics Class They Are Taking 



Eighth-grade Mathematics 


Pre-algebra 


Algebra 


1990 Grade 8 


1992 Grade 8 


1990 Grade 8 


1992 Grade 8 


1990 Grade 8 


1992 Grade 8 
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fi'CO.6) B 


^”'^(‘‘1,1).^^ 


•19832 poSjBF 


‘ 85,o1i f>: r \ 




!! 218 { pjijit: 
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r.?) ‘ ‘ 




:p;: *Vy 


•..I.:.., 


Nation 


ISji 70 ( 3.5) ':’. V 
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State 
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v Vt 35 s l\ 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. The percentages may not total 100 percent because a small number of students reported taking other or no 
mathematics classes. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE A17A | Teachers’ Reports on the Amount of 

I Mathematics Homework Assigned Each Day 



Trial State Assessment 
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15 Minutes 


30 Minutes 


1992 Grade 4 


1992 Grade 8 


1992 Grade 4 


1992 Grade 8 


1992 Grade 4 


1992 Grade 8 
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i ! Percentage of Students iniiSI 
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Math Proficiency ||||| 
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TOTAL 
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17 ( 0.9) 'llllill 


: :1 i i ‘ : :)i‘ t: : : L: : 


60(1.2) ' • 


752(1.3) f||! 




t { * -Vf* ^Mr, | 


[ ‘‘ t | { tHHt .£#* ‘ r V 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
Comparisons between 1990 and 1992 are not possible for the teacher responses because of changes in the form of the questions that they 
were asked. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
Comparisons between 1990 and 1992 are not possible for the teacher responses because of changes in the form of the questions that they 
were asked. ! Interpret with caution— the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500, The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level, ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic, *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE A18A | Teachers’ Reports on the Emphasis Given to 
I Numbers and Operations 
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table A 18A I Teachers’ Reports on the Emphasis Given to 
(continued) I Numbers and Operations 



1992 

Trial State Assessment 



Heavy Emphasis 
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1992 Grade 4 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of-the difference (see the Procedural Appendix for details). 
The percentages may not total 100 percent because the “Moderate Emphasis” category is not included. Comparisons between 1990 and 
1992 are not appropriate for this content area because of changes in the form of the questions that the students’ mathematics teachers 
were asked. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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table A 18 B I Teachers’ Reports on the Emphasis Given to 
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TOTAL 



State 

Nation 



PARENTS 1 
EDUCATION 



College grad. 

State 

Nation 

Some college 

State 

Nation 

HS graduate 

State 

Nation 

HS non-grad. 

State 

Nation 

Don’t know 

State 

Nation 



GENDER 



Male 

State 

Nation 

Female 

State 

Nation 



w 

•Isiilfti-ip! < <« '■ 'c » < ( 

11 

isi mm ■ 

Ai'*' ' an .• : : : ;&!!& \ 

! v '< . 

* • •{ ' { 

r!:-:::: : - i : ^ i I i i : : • i i i : ^ ; : i : : 

:- •{. •« r . 

MPtiNPIl 

.•-'197 (-1.9! 
pli8S : i(T.9): 
fc,:52iaTlH:HS; 

fc a. 

ill 36 ( 3.4) 

mm# i 



Percentage of Students arid 
**•* ”Ayeine9® Math Proficiency 






' 25 ( 0.9) 
l|lp:p;5)S 
’ '"«T 3.0) ’ 
■J'2«>{48) 



,;i! 



iSpgtf* ( o, 8 ) < i 

i$ti^ii4,7) i ■ 
SrHtliiiiex 2.0) • ' 
tp* ;vas&< 3,o). ' -i 



tn\ 5 : ( : s \ t\ u r. y * { : 

26(1.9) 14 { 1.7) < •' 

.294 ( 4 : 0 ) ' ,!: >223 (,L 2 )': . I 

ie.,{3.3) ,, gflii 12 { 1.8) *|! 



“''-264 ,(,5 9)! ■ ‘ 269 {4:0) 

«* J 

( ; .■ v . 24 j( 2!4) 



16 ( 2.6), A 

*** r*-* n 



"ss .sia iia> 

™ 4 » « 

. «!“> ' ■«!«) .«(«>. . 

fjgSi«s« 



I! 1 j 



iSlSSSi 

21? <: 

Sllilliil® 

llllllllil 



*.s j 






1 j¥jl4 (-2^1 ) 33*19 ( 2.9) 



7( ***>‘;^;*; I 25Q{3.ar 



£17 (■ 2.6); 

S&f'lSf). 
ili&ipsiii 
m&t rj> :. ! 



m 



..<“26 { 1.4)' 
219(3,1}, 
Us. i7<Mrj 
266(5,6)* 



1(1,3) 
‘ { 2.6) 



IIS ^ 
fi:!i7ii(i!S,2) 



p25:(;;6,3) «. 
& if l5 ( 16) ‘ 

16(1.4) < 

1216(45) ! 

I®7i!(;2*1|!=! ? 
1=251 •( 3.9)- <••• 



iiiilliiliii. 

.4- 221- (<3.6)1 



Percentage of Students and 
Average Math Proficiency 

I' <S • ’ !t * <: V' 4 * : Si . I s» ; I !!| ; , v . * 

:b $M 3 • Mr 

U =«:; ‘ . .<onr<n.Q^ *•< ! = -5 (. 0 , 6 )^ 



\M (:!o!6j| 

1 lip 2,6) ilillillll ;;261 :(11,0);-. I Pi 

*.*‘33(4.0) i$(i,6j< 

* ■' ’ v 'I 1 *-. f 4 



rnmmm. 



2 ( 0.8) . k[;:!4allII||IiiiSl 

S|Mpil ''255(5.6) 
8jiv'. ‘e-P^L ••<p.slfii;37-;(-3:6)i 



St-227 (5.2)1 ij,V 285 ( 3.1 



0.9) • : / ■»( 

1*.,.) ! ,(i' .232 ( 
2.0)' V 39 { 
**$>"•' \ 278 ( 






II- 

IB 2<0.9) 

frtNr 

7 ( 1-4) 

rnammWKE 
m. 

3i( 1.9) • • • 

SKI 

?'-6i|.J.3) 

' 7245 ( 4.8)!. 

mb 

, '3 ( 0,8) ' 

6 <s^| 

<1< ;'mj 5,2)h 

'tifak* 

217- (i(*s2|l 



!l! 81 llill!ISSI:i! 

lSI:f ? fpl 6 ( ilfiiilll; 
if Mis 4,. v 

JMI 

■ 224 ;( 4.7) i 
27(5.o) 

11 

* **' s ^*l^ *’i’ e «‘?* «* *ir ‘L. ' - ? 




. 26 {..3.7:): 



/c|‘ 
*!<< * 



mmmm 

<t:,; . 

<*< ' ‘< <26 ( 4.1) “ 

, . -*-*-*. e-j 

lli:|ll;|l|||! 

f>:;24i c : *3);::;: 

• :3a;{ 3,6)*. • 

:<;.; r ’‘277 { | ; i4,4)‘ { 

iii'21 { 1 1V 

Ilfii23ir!{ 3.4)?? 
!S:ai: : 35( 4;3)-;:; 

W : 267 *{ 3.6).*:- 



11:8(2:8) |if 

ifiMt 

liiiiiisiai 

li'-'f 2.5) -£ B' • 
(4»hrV;> 



:i264; 



' 6 ( 0.8) W 

•kl6{-l'6) :< 
'261 ^ ‘3.6) \ \ 

6(1 .0) < ; ' ; 

*+* |+-» <- 1 

,‘.15*{ 16) <s<„ 

*260{ 4.5)<i 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. The percentages may not total 100 percent because the “Moderate Emphasis” category is not included. 
! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample 
size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. The percentages may not total 100 percent because the “Moderate Emphasis” category is not included. 
! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample 
size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
The percentages may not total 100 percent because the “Moderate Emphasis” category is not included. Comparisons between 1990 and 
1992 are not appropriate for this content area because of changes in the form of the questions that the students’ mathematics teachers 
were asked. ! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500, The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. The percentages may not total 100 percent because the “Moderate Emphasis” category is not included, 
! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this statistic, *** Sample 
size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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si 
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Mis)^ 
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',•/ ‘W&U M 
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* t * « « * 
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State 
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1992 Grade 8 


1992 Grade 4 
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1992 Grade 4 


1992 Grade 8 
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i Yr « \ 


1 ,« c , 


•| \ • III '• Y . 1 . { 1 ' 
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S!IR ; < tcplF 
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‘‘ ' 53(1.0) ! . 
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■ 
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IpT iilY* • 


"1 Y V 
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:,kli,97'Lii.5) 
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'■< ,.,.'237 ( 2.4). • 3 
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Iililaia ( 3£)‘ 
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' 
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SI 
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M . : i 255 B»b ■• T f 
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I * ■, jj 
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State 
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' i Y’ { 


1 183(2 
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^•c*- r'.*) 7. 




Nation 


FilPili s.2) : •: 1 1| 






•l li -'52f(^l)i^ 


-11(2.0) ■' 


’fcT?. : ", '39, ('i6)'V, • ! 




iiipil^o).,/. 
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. '216(3.8)1 ./ 
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■ - • < :.Y : 
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‘ ... , : 
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f *• ' ,4 J t „ * { { , f 
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State 
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Wi 


:?Slil i ii:;:S#S 


36 (2.2) M 
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Nation 
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SM^SSfflKESSj^-Sj: 




Y!||2i(l2vO) , ■ ■: 
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llMii) «i 
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•• ,V • • ! : : . ’ • Y 


t I t* v. * t 




f • « . r • ’ ‘ ^ 
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State 
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% jm HI \k 
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t: E252 ( 0,8) ‘ : ! 
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Nation 




3) 1 


1111# ( 2^9) - € t ! 


so ( 3.i) ! .. ; 




. ,! . 42 < ,9 
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4,3).- ; 5 : f : 


^3216 ( J li9) , 
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S-i3^ : f2:3 )!!S-.;=‘: 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
Comparisons to 1990 are not appropriate because of a change in the wording or format of the question. ! Interpret with caution - the 
nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a 
reliable estimate (fewer than 62 students). 
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;ji|||;;;;Avera 9 e Math Proficiency lli 


. .Average Math Proficiency ! 
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• : V: >: *52 (1.6) 
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liii Gllifi 




ill i '39 (:4.7pi 


■;!!!: s; i e8 : -t'4t.6)‘, if'' 




lltl-sjli! !l^&=rfc:^ : == : 










$,y;!;-r : 22i‘{4.l)!p-.s' 


Nation 


p'v 27 >'■ 


Iipp:..';®! 1 '18 ( 2.0) Vf - : 


ll!iS ; !(S2:S) ; ! 


!l : 5lS !: ^v2i‘'(i£2^ ; ! l-i : 




!| 1 ■'•• '61 ( 3.3)' m 




111196: (4.11:; 


25i',{U.3) ( ; ; ''.'s‘,.,: 






life!: 203 (|;3)3)?,|i 


II Jl246|[2.o) iiiiil 


Don't know 




"3 5! =’ '= =■!( *!•*' '• •i*' < ‘ !f 




.,y yt /|{; ‘ ^ \:«Cs * j 


' M •: VSr: \ !*•!; ‘ { * c * • 


i!i:.< *tii i: illlHHin'k? ■ ■ 


State 


3;Jf S3 f ,1-9)“ 


’S" • I- Si : LK) { -2.9)1" ■ ■ ' 1 


.US:: :i5 ( 1.1).:= 




32 (1:7)' 1 


!* <1 . 62 ( 3.2) 1 






if IfeiJ '•■ •' 


: €* i9l ?(i3:6)-'> 


y j 


■ Ii:i844;ii.8)- :i s 


III! 229 ( ‘3.0) 


Nation 


IIP 35 (5:1 25)1! 


111 ■ ' 19{ 2,4) • ®| 


1111321 pliSjfl 


« 


3Sil,'43j(Pi1i6)' m 


::i(|IIN- : 59 ( 2.6) 




jipi2 iiidi 




^‘.218 ( 1,T) ' 


: { ij'.V ' { l ; ; 260 ( 4.1) 5 


f 11209 ( .1.2) || 


S(j: -249' (<2.2) : 


GENDER 


**:« j : ' '( t ‘ y : 


:::::: :: r:*Scr j r||: -i: 


WW. tf 




1 : ;!i «* { ! ,• i i 


V; : : 'K ;( ‘ t «; •; « ( (' 


Male 




!||: • :: ;*?: . # < * | t 


, • ' • ;i, ' ' 




‘ * «Sv * 




State 


W:¥46 ( ‘ 1 ,6) 


’ \ 23 ( L6)‘ 


,\, 19'( : 1.2). 


( Sj - 8 


Illir n 31 


S|feS::if ! S4 ( ii)M® 






\ * l ’ ‘231 ( 3.0) t , 


,,2b4(2.7)'. 


11 ..241 ( 3.7); \ 


■1(158 ( *1,9)' 


iiiilliB 23t (-1,7) mi 


Nation 


:l!||;;36 (.1,6) 


' !■ v‘ :. t 23 { i.6) W 


ill:: 23 ( 0.9)= 


j-m 1,2) 


«r <4i ( i&)< ' 


- t . <49 (L9) (F- 




:jg215^1.S) 


.:262.(2.0)< || ;; 




' I'N; ^ '.i272.;Ci^)' f; • 


'' -2i7l( r:3) • 


'265 ( 1,3) - t 


Female 






{ { { v '■{. \ :! t.‘ • .•'* 




ji." A :• 


;; S’ •• * ■ • » 


State 


PI? 1 54. f 15);;! 


,, ' l 20‘(1.6) = ;•: • 








;= 'Ffe, 61 | : i sfMA 










=;iy : 


«l ; i : Pi:(!^2)i( 


«0PH« (S6) ! fl; “ 


Nation 


• •' = ••34 ( -1,3) 


‘ S ‘ 13‘{1.2)‘ '“/i 


I811|;fi24,(:;i : l2)|| 




•(. ,42 (1,6). 


:!(:>• « :$5(lL8) *.* : 




iiiiil 215 ^18) 


i " 'c : i : '265 { 2,2) |« « 




.A : ; '-\ : 272 { ‘ 


|S j 2i2=(:-i.5): : ;:F:: 


: <:265 ( *1,4) «« • 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
Comparisons to 1990 are not appropriate because of a change in the wording or format of the question. ! Interpret with caution — the 
nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a 
reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( <) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution ~ the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



ERIC 



^^NAEP TRIAL STATE ASSESSMENT 



199 



195 



District of Columbia 



TABLE A27A 



THE M 


ATION’S 


REPORT 

CARD 


rasp 


1992 







Teachers’ Reports on the Frequency of 
Computer Use in Mathematics Classrooms 



Trial State Assessment 



At Least Weekly 


Less Than Once a Week 


Never or Hardly Ever 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 



TOTAL 

State 

Nation 



RACE/ 

ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 



TYPE OF 
COMMUNITY 



Adv. urban 

State 

Nation 

Disadv. urban 

State 

Nation 

Other 

State 

Nation 



mm 

f s 4 ii;fo. 6 )? 

Mi 

liiiiiil 



lihipercentage. of students and 111 
;; ^Verage Math Proficiency • 

• iia \ fi.7) ; ,r «' <( o:r)! ' ' '-"is fo.s) < 

: m%. 1^4)3 

i4SiBll) :; 9l246 ( 



fY, Mi • 






‘ft!;",; 



Percentage of Students andSilf 
Average Math Proficiency 

23(0.8; 36 ( 0 9; 26 ( 1.0) < 

, 20 22) ■■ 1 1>M (-.45) :• ^ 18 )>-s 

21«iii(Ii):¥ \ 264 . ( :3.4)182i^ 4®3)i ‘ “ 







; 2**^! 




28 


:{'3(0)' : 








' T? t A2)',j 












mm 


dr** 


mem 




(**>) ; 












if*-*),, 








m 


1 m e 




'21 






|Sf'18 : 


<-2.;6L< 


SSSS&Lin'l 




;(4-4) 


IS:76'(-25): 


> 


251 


§|5.9)! 


287 




226 


1 3|) l; 


:-;:>?T1( i '3i.2); ] 


'&75' 


(2.2) 


226(.2:1)' 1 


\^p2 


( 2.0) 




i}!! 


. •' 22 


(0.9)31 


'18 




24 


111)"; 


lip pl|! 


{ ;ii:ii:28 


ISilS 


lim o.9)i! 




( LI) 




iS; 


:!;&&! 


Mm 


.^•297; 


illii 


W& 


■M)-' 


;-233,(:i.4)!';, 




liiiil 




Wa&B; 




i|pi; ! (iSi)S 


||i|: 


; is 


(7-0) 


' 13' 


warn 


11® 


< 2-6) , 


29 ( 8.4)'.;’ 


' 20 


ip.e)p:.: 


SiilliM Si 


ilgl2: 


i\7.7);, 


■ egi| 




liiij W$\ 

; 


mu 


s.,231 


wmm 


195 


( 2.7) : 


' 240 ( 3ip 


239 


-Bm 


180 ( 2;9)! 


; 242: 


(5.0) 

< { '< *! 


238(2.1) 




< i \\< l\ ' ; 

I 25 


Hill 


13 

“ 


ISlI; 


22 


i 2I) 


S*40' : (:-3;4) : s' 


27 


.(■'3.5)5^ 


' 12 ! ; 0 


j l : 35 : 


(3.8):::; 


!ii ( 4.6)5 


> 




•£*'.r.){V 




pill 


+**- 


<(**.*> :'• 


;s-:; iy ; i 




c^-rUti 


j?1<i3.6) 


;:.j 


; (".*):: 


ii£7i(i6lp 


I.;; 


lliiio 


(3.2),, 


13 


13-1) v, 




( 2.2) 


28 ( 7.4) 


SSiljl' 


< 3.7) 




84 


(7.7) 


»ap#2:(i!4^.j; 


, V 


; ,!< ><> v 


ev> 


• 232 


(%6);§; 


192; 


1111 


245 ( 4.3)! 


|i4Q 


( 4.7)! 1 


193?4.0)' ’ 

. ■ k AiVi 


: 248 

*• . 3 * 


< 4.4) 




IS 





f v 28 < 0,9) 


iPipii 


i 2? 




7«4$! 




■N( ab)'l 




5;V-2«4 1.2)1 


: ; Vs§5 










221 : 


mMi 


S26H! 


nssr.fi 




^ i**n :j 


J285:p8)‘ 


SHE 








lililsil 


:;: 30. 


:L9#M1 


IpO; 


P5.8)I 






llWiii5,2)i;i 




■p8^)!J5 










|HW* d 


« { ■■***' 


* J : : 




« j' 


liiiil 


| : 290 


illii 


;‘s42 (om ; 






I 20 


illf 5 : 


Sfai 


ill! 


l28(Ppl 




® 52 X ttyir 


ffllsi: 


ns in 




Ip-fflliffi 


| 231 ( 3^) h \ 


184: 


Mi 


1 ^ 5 ; 


aw 


;|226 V£3) : !| 




S228:i( : 1;2>- 


7223 


(12.4) PI? 


iii?7 IfH!) S; 




y.? t e(73); i 


17 




llM; 


(I2^)lfi 


7Pl9<^6)l s :f 


;B28^ : 8;2rS! 






(I75)IS 


i96.(3;6)r| 


lliiiii 


;232 f 5.0]J * 


202 ' 




$W5fj 


(,85))' 


; t,-* 1 ** t •• * 


Miiiipi 


^l;4.9)!l : : 


324? 


Hill 


ifliri,: 


/ i^lH® 


^‘12 ( ii)s; ! 


'^1 


1^1 


I® 1 


■( 2.1J - 


Ii20(l$r< 






1187 










198 


< 45);/ 


$!2^ 


iP-Di 


,s238 ( : 2i9) :I 


ii94 ;: (S0)'l 


‘'829ClSS)B 


7280; 


(135) ■> 








120 ; 


L2*> 


gBe; 


P4)K 


1 


128^^3) :f 




S-75 


(?2;6)'> 


.21^1,7} 7 






215 


tmm 


11288 


;( 3-3) V 


?iwS<SS):g 




‘ 283 ( 23) I 


; 271: 





ftlliipeo^tage'of Students and if i-1 

® '{ ! lio) ‘ T59ipp® 

>: gm &i m> 

«14 f (2,5}' ttt t 266<c^r < 270 t< M,4f * 



. { « ¥ 



V Stf 



p-aiii' • 



1 [ < ( f '( s \< a 1 { {‘cj*<! (« * i<. . t ' v 

t * V is!:!' 

V ( ; 1 !i!;! j! Jf | x’?\\ i << i !< { \« ‘ 



(continued on next page) 



o 

ERIC 



200 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



District of Columbia 



THE NATION’S 
REPORT 



CARD 



table A 27 A I Teachers’ Reports on the Frequency of 
(continued) I Computer Use in Mathematics Classrooms 



raep 

M: 



1992 

Trial State Assessment 



At Least Weekly 


Less Than Once a Week 


Never or Hardly Ever 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 


1992 
Grade 4 


1990 
Grade 8 


1992 
Grade 8 



TOTAL 

State 

Nation 



PARENTS’ 

EDUCATION 



College grad. 

State 

Nation 

Some college 

State 

Nation 

HS graduate 

State 

Nation 

HS non-grad. 

State 

Nation 

Don't know 

State 

Nation 



GENDER 



Male 

State 

Nation 

Female 

State 

Nation 



Percentage ;of Students ihd : 
‘ Average Math Proficiency 



1 42, { : d!7) ;t ' 22 (0.7)' 

:i95{'l,4)'7.234(H'.'4) 

• 55 ( 33)llflft2< £:5> SS 

-246;:(isa)i:is 



151(0.8)1' 

23$ ( mm 

mm 

252(35) 



.43 { 1:7) i,'24 ( 1.7) '.‘XU 3(1 .2)li 
203 ( '2.1 ) , 240 ('3.'3i:’'! ' 

‘$4 ( 3 'A).d: "hp < ;2.8) wV,7--(. 155) 
225 { 2.3) 2611 ( 614)1 269 ( 4.8)! 




222 ( 3i.Q)1f 



^) a| 257; T :6.0)! 1 



lid (.3:0) "vV 2d ; f’i"4) • 20 |®8j t 

Iki { 3Siii^2e=p.8) ipiaio i 35) '! 

,M f4';7)'“ i 13'( 45) ,'1 : . 18 T- 1,v4) ' 
21,57(42.0)'!):.; : ;j!: 543 ',(, 45 ) 

: V* * ■ ‘ ■ 7 " f i' ! ; fr - v ; h % «, i! : i 

M8d ft-!~srgi ?3.7i 

lil|il)l ! >lfl|5;8)' ii7; i 6: ( 2lo|i 

20 ) ( 

iilliill 718 ( 3.0) 13 ( 2.0) 

%S( f 2aj si-T^'if^’)- fc'iSsS (?*.*•) ! 

S58 ( ! 3.1 ) ■ ■: 'It < 5.2) ! '- ‘1 i>( 2.1 ) ' 

213.411 .5) I.; *i!? 7 p;t:) 73 ? 23 i!i (isSp 



"41 ( 1 ,2) Iff MM * ) 1 6 pl5);;| 

' 1 96 ■ ( 2.i)‘ • . 232 ( 2.1) V, 234 : ( 3.7) 
757 ( 3:3) lfBa!2.(.3.5)liiiiK( 1:13) 
;||1|||) I 245,(6.8)1 I 252 ( 48) 

II (13)77 l III ( 11 | 15' ( 13) < 
185:(‘2.p) V, 236 ( 2.3) ■ "242 ( 3.7) I 
54(3.6) ■ 12 ( 4.0), i|i!;7 18;: ( ,i 3) : 1 
216{‘1‘.8)', ' 247 ( 5.9)1 . 252 ( 4.2) 



Students and i 
||:Average.Ma»h Proficiency " 



i 36 (.0.9)7 ; : ;“26 (:1,0) • 

"ma 



23 ( 0.8) 

193 (1.6) 

iSSM 

218, ( '2.8) , i : 264 ( 3.1 ) 268 ,( ,2^)7 



Sil9pi'233 ('1.8) 



,25,(13) 1 

SSftpjy, 

2^y, 

226 ( 3.8) 

. 34 ! t 4.4)7 

221,(5.1) 

2i> ( 2.9) 
Sib;(4.i)t! 
Sl9 (.2 8) , 

WmBBSm 
m ( 53) 

5lk:(:3.6)i 

j** 4 j 

19 ( 1.6) 
185:(:;23): 
119 ( 23) ! 

USpJ) 



wms$m 

193 : .(2;ZJl 

20(24) 

219|;3.0) 

25 ( 1.1) 
194 ( 24);., 
7,30 (2.2) 
218' (33) 



■ 3B (.24), 
1 !247 ,{ 43), 
(\ 33 ( ‘5.0)' 

7275( : 3.7)!; 

' 36 ( 2.5) 
5240; (2.7),:; 

265. (‘3.1) ’ 

34 ( 1.9) 
,<229<‘( 3.0) 
iii-39 ( 5.8) i 
258 ( 3.1) 

'43(3.8) • 

llfited) - 

38 ( 4.1) 

' 225. (3.4). 
1* 29 C‘5.0) 



38( 15) 1 
••235! (”3)1) 
,.“34 r (4‘.4)-. 
!< 205 ( 33) 

30(14) 

l239l('2.0) 

!i34:(.'!43) ' 

: 263 ( 3.3) 



25 ( 1.8) < 

"237,(33) v 
iSfii (.2.4)7,,' 
|375;(:;d.1.):J 

27 < 2.3) 

l243ipS|S| 

271 < 2.5) 

27 ( 2.0) 

7225:¥3;o)'“' 

; 16;$SSpl 

i/?^p;-l| 

• 15 ( : 3.0) < 

■*“(**.')■' 
16 ( 2'3:B 
244 ( 4.8) 

7?33'( 3.6) 

— (**.-) 

l!?: 1 17, (2.3)7 

...2Sl' < 4.1') • 



; 528 :(-;i 8 .):<l 
;230ilf)! 
iif'18 (.24) <1 
p3;,< 3.0) 

ittKl.8) <1 

235 ( 28)' 

18 ( 23) ^ 

!2i®:(|24) 



Percentage of Students and 
Average Math Proficiency , 



35 fl.O) 'f7 •;:; :42 •( :08) ’ v , 59(13) • > 

p55iM) • 230 (:!Sl)S!i236'(ii;6)!ii: 
■;24 { 2.9) 54! ( ii2)!ii!tf .(!!2fi) : i® 

214 ! (,2.5)‘ ,206 j( 2.2) • 1 1 '27.P l(| 4) " 



32 ( 1.8) 
180 ( 2.7) i 7 
• 25 ( 32) f. 

'22d;p:ii)|l-ft 



235 ii:i.7) 

!ii78|i!6): 
276 Til) ; 

. Mpi) I ’isl 

! 4'23if ',(23) 

27 ( 4.6) 56ifiii| 

22*,(,%0j ! ; i;,:;274-t2.4'i 

!aS8a * ’ ' "c*Vl«i'c C : S' V'S' .i \ 



35 ( 3.0) 

i83'(i2;S)Pp 
23 ( 3:8]|| 

207 ( 4.2) , 

' 

- 357 [5.7):.. 

o-t-* '^*8-. #y 

198(4.6) 

209 



•7 : 46l 

225 

254 

34 
... . 

' tie' 

wm 



1.9) 
2.3) 
P53P 

2.5|; : 

3.9) 

5.7);! 
fjt.o) ; 



!j!!Plli:7pi|ii 

2 i^l|!iS)i 

:i5S'#:2);'; 

i47:.(5.i:)i; 



•■ , ! 62' ( 2 .o): > 
1250 ( 2.9) 7> 

:„,.;,74'(,,2;4) p 

182 ( 7 i,- 7 )' ;:■ 

;?237‘.(:!2^)lfi 

! P727(3'i3)'&il 

53 ( 2.4) 

7525 (:'2;6) '7 • 
76 ( 2.5) > 

;»259';|i‘,') .7) 

5i:7d :: ( 3.8) > 

''2316: (44) i(' 
;,774 !l (28) 
:;;i|56;i|22)|i 

S'llSi(;3!9i)5^ 

:.229f(,'4:7)l;w 

i s;71 ( 2.9) Sf 
'■256 (,23)21! 



S‘S‘ j : 



&\g£i$ 

;?P|p.qjS 

33 { 1,1) 
105 

213(2,7) 



ntimWt 
1:220 ('2 :q):S! 
::i':54 { ‘t.4,2)Vi'. 

‘2S7 £ ( 2,S);;v 

E2S4::p=3il 



a,74;(«;2.2)^ 
270 f|J6 

270;(IB)jii!‘ 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( <) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within db 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
Comparisons to 1990 are not appropriate because of the changing nature of the calculator-suitable and calculator-unsuitable items and the 
changing nature of the definitions of the “High” and “Other” groups from 1990 to 1992. Students in the “High” group used the calculator 
for at least 65 percent of the calculator-suitable items and used the calculator for no more than one of the calculator- unsuitable items. 
Students in the “Other” group used the calculator for less than 65 percent of the calculator- suitable items or used it for more than one of 
the calculator-unsuitable items. ! Interpret with caution -- the nature of the sample does not allow accurate determination of the variability 
of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details), 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE A35 I Students’ Positive Perceptions and Attitudes 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural Appendix for details). 
If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 
percent confidence level. — “Strongly Agree” and “Strongly Disagree” were not response choices for Grade 4. A “perception index” 
of 1 represents very positive perceptions toward mathematics and a “perception index” of 3 represents uncertain or negative perceptions 
toward mathematics. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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